-- Logs begin at Tue 2022-08-02 09:26:16 UTC, end at Tue 2022-08-02 11:10:15 UTC. -- Aug 02 10:11:39.671769 dv-cinder-847536-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:11:39.680419 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:11:39 2022] *** Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: nodename: dv-cinder-847536-4-iscsi Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: machine: x86_64 Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: clock source: unix Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: pcre jit disabled Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: detected number of CPU cores: 4 Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: current working directory: / Aug 02 10:11:39.682392 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: your processes number limit is 47680 Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: your memory page size is 4096 bytes Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: detected max file descriptor number: 2048 Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: lock engine: pthread robust mutexes Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: thunder lock: enabled Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:11:39.683018 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:11:39.722121 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: Python main interpreter initialized at 0x55a20f66a9c0 Aug 02 10:11:39.722121 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: python threads support enabled Aug 02 10:11:39.722121 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: your server socket listen backlog is limited to 100 connections Aug 02 10:11:39.722121 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:11:39.722493 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:11:39.722568 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: *** Operational MODE: preforking *** Aug 02 10:11:39.722791 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:11:39.722791 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: spawned uWSGI master process (pid: 103778) Aug 02 10:11:39.723013 dv-cinder-847536-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:11:39.723586 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: spawned uWSGI worker 1 (pid: 103779, cores: 1) Aug 02 10:11:39.723924 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: spawned uWSGI worker 2 (pid: 103780, cores: 1) Aug 02 10:11:39.724085 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:11:40.386686 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:11:40.389478 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:11:41.490975 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:11:41.490975 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: from cryptography.utils import int_from_bytes Aug 02 10:11:41.491611 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:11:41.491611 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: from cryptography.utils import int_from_bytes Aug 02 10:11:41.494650 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:11:41.494650 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: from cryptography.utils import int_from_bytes Aug 02 10:11:41.495097 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:11:41.495097 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: from cryptography.utils import int_from_bytes Aug 02 10:11:44.022445 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:11:44.023114 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:11:44.023538 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:11:44.023629 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:11:44.023719 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:11:44.023801 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:11:44.023921 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:11:44.024073 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:11:44.024243 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:11:44.024377 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:11:44.024454 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.024521 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.024586 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.024867 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.025184 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.025431 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.025562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.025765 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.025933 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026091 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026180 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026426 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026517 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026736 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.026815 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027047 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027125 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027390 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027488 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027713 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-4-iscsi {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027799 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.027979 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028072 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028301 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028399 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028620 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028698 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-4-iscsi {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.028939 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029022 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029243 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029330 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029555 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029644 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029857 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.029933 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.030168 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.030488 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.030597 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.031597 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.031773 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.031773 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.031934 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032015 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032119 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032200 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032266 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032332 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032417 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032492 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032570 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032636 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.032860 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033026 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033175 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033267 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033500 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033596 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033819 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.033917 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-4-iscsi {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034145 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034255 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034458 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034567 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034826 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.034943 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-4-iscsi {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035181 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035327 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035520 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035615 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035836 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.035933 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036163 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036514 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036615 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036811 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.036912 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037136 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037223 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037455 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037543 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037765 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.037870 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038081 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038166 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038382 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038467 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038688 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038776 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.038999 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039098 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039326 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039416 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039669 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039763 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.039976 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040064 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040244 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040342 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040537 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040625 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040857 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.040945 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041117 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041210 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041427 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041718 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041815 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.041970 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042068 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042287 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042374 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042605 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042691 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042859 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.042956 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043180 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043301 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043513 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043614 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043816 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.043911 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044121 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044215 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044427 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044520 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044730 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.044829 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045032 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045124 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045338 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045433 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045644 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045741 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.045950 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046036 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046254 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046348 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046569 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046651 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046892 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.046993 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047223 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047314 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047520 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047617 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047857 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.047951 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048154 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048240 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048463 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048557 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.048870 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049093 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049188 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049400 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049487 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049706 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.049799 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050009 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050109 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050323 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050536 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050727 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.050823 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051038 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051140 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051321 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051464 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051621 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051800 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.051928 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052023 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052240 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052343 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052663 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052851 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.052945 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053155 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053255 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053452 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053550 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053758 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.053845 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054058 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054151 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054356 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054452 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054666 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054772 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.054969 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.055590 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.055809 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.055899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056117 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056204 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056422 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056509 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056725 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.056813 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057029 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057136 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057338 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057431 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057642 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057729 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.057945 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058039 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058250 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058347 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058553 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058642 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058857 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.058943 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059159 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059312 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059487 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059583 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059803 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.059895 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060107 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060193 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060411 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060498 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060727 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.060813 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061045 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061162 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061321 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061411 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061661 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061756 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.061934 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062036 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062236 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062328 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062545 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062631 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062842 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.062936 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063144 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063249 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063474 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063563 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063777 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.063924 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064063 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064206 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064368 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064509 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064675 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064817 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.064983 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065140 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065274 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065409 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065574 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065714 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.065876 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066007 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066174 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066307 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066491 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066635 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066793 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.066924 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.067110 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.067331 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.067477 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.067610 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.067743 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.067886 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.068040 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:11:44.068239 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.068382 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.068592 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.068727 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.068930 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069018 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069282 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069379 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069605 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069700 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.069918 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.070013 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.070232 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.070320 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.070558 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.070645 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.071448 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.071548 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.071768 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.071864 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072085 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072172 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072401 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072486 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072719 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.072806 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073040 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073151 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073360 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073485 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073680 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073780 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.073999 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074093 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074314 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074402 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074634 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074728 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.074950 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075044 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075294 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075386 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075607 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075701 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.075944 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076030 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076259 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076361 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076584 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076678 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.076906 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077001 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077229 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077325 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077545 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077857 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.077951 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078168 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078264 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078482 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078569 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078799 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.078894 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079108 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079238 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079451 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079539 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079766 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.079862 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080080 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080168 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080393 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080478 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080704 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.080789 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081015 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081110 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081327 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081413 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081647 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081742 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.081962 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082059 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082275 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082363 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082590 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082685 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082904 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.082997 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083227 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083328 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083539 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083639 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083842 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.083936 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084147 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084236 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084451 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084547 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084755 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.084841 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085063 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085150 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085379 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085478 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085685 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085779 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.085992 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086079 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086338 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086439 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086657 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086745 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.086970 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087102 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087309 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087400 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087623 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087712 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.087929 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088016 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088242 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088330 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088548 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088635 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088852 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.088937 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089166 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089253 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089476 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089779 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.089865 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090101 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090197 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090408 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090495 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090713 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.090808 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091028 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091114 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091364 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091464 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091678 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091775 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.091989 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092085 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092302 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092390 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092615 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092710 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.092925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093012 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093323 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093554 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093686 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093871 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.093960 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094176 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094261 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094498 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094588 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094822 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.094910 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095143 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095268 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095471 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095572 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095783 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.095870 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096086 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096173 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096389 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096477 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096691 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096778 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.096996 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097081 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097299 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097438 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097585 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097730 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.097889 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098043 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098175 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098320 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098465 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098608 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098776 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.098925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099063 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099149 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099400 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099501 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099705 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.099802 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100009 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100096 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100315 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100621 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100718 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.100966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101053 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101271 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101360 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101604 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101691 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.101926 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.102570 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.102869 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.102966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.103209 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.103302 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.103530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.103618 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.103845 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104001 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104154 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104304 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104441 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104584 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104760 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.104891 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105069 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105205 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105390 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105523 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105702 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.105789 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106023 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106111 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106334 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106421 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106653 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106748 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.106957 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107044 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107299 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107402 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107608 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107703 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.107932 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108026 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108258 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108352 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108578 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108674 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108887 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.108975 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109203 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109341 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109513 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109655 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109821 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.109966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.110129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.110262 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.110698 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.110834 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111011 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111145 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111342 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111483 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111661 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111801 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.111973 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112103 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112292 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112424 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112589 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112744 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.112905 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113002 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113227 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113323 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113523 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113613 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113828 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.113909 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114149 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114244 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114463 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114551 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114773 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.114869 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115095 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115216 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115435 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115534 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115745 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.115833 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116058 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116155 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116363 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116452 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116667 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116755 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.116972 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.117066 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.117282 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.117409 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.117645 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.118230 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.118454 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.118551 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.118760 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.118848 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119073 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119158 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119408 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119497 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119713 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.119813 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120018 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120107 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120322 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120415 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120630 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120718 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.120938 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121025 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121260 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121353 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121573 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121667 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121879 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.121971 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122184 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122273 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122502 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122587 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122810 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.122909 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123113 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123335 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123428 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123555 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123732 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.123830 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124047 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124142 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124353 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124440 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124667 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124761 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.124985 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125072 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125293 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125379 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125609 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125749 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.125926 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126015 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126239 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126323 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126635 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126862 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.126947 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127176 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127305 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127507 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127596 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127816 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.127910 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128127 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128214 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128437 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128524 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128744 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.128829 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129055 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129141 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129365 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129453 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129674 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129762 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.129983 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130084 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130287 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130374 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130594 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130679 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.130900 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.131001 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.131230 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.131516 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.131603 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.131849 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132122 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132217 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132460 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132777 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.132903 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133094 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133282 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133447 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133534 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133771 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.133859 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134107 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134202 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134436 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134533 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134748 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.134842 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135154 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135393 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135499 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135700 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.135838 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136024 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136103 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136295 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136395 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136600 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136687 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136903 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.136996 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137205 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137300 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137509 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137637 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137811 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.137899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138114 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138208 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138421 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138515 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138721 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.138807 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139031 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139120 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139359 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139502 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139671 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139757 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.139978 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140067 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140280 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140365 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140585 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140681 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140887 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.140981 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141189 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141275 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141494 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141590 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141840 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.141928 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142156 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142250 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142496 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142591 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142801 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.142888 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143104 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143266 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143453 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143541 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143759 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.143860 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144062 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144151 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144364 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144460 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144666 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144753 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.144971 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145059 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145270 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145358 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145585 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145673 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145892 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.145979 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146204 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146299 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146514 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146600 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146814 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.146900 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147125 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147232 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147453 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147544 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147765 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.147863 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148072 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148160 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148372 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148465 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148674 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.148780 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149014 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149157 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149326 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149509 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149628 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149830 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.149925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150146 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150240 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150454 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150541 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150770 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.150859 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151079 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151167 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151415 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151549 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151722 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.151809 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152029 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152114 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152331 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152425 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152647 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152734 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.152953 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153047 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153257 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153343 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153559 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153637 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153868 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.153946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154170 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154256 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154473 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154549 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154779 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.154857 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155080 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155158 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155413 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155493 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155813 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.155911 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156059 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156156 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156333 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156429 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156635 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156722 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.156936 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157032 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157241 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157328 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157541 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157628 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157844 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.157931 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158143 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158228 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158445 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158550 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158748 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.158834 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159053 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159140 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159387 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159489 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159690 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159776 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.159995 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160083 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160298 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160395 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160602 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160688 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160905 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.160992 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161207 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161303 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161554 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161644 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161859 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.161954 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162179 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162266 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162489 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162578 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162800 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.162889 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163116 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163222 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163447 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163536 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163757 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.163844 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.164065 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.164159 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.164366 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.164941 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165190 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165275 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165498 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165587 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165812 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.165908 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166118 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166212 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166424 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166520 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166742 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.166829 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167069 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167232 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167399 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167487 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167706 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.167794 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168018 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168122 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168327 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168415 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168629 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168715 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.168936 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169031 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169244 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169330 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169551 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169637 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169858 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.169953 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170164 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170250 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170471 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170565 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.170864 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171083 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171178 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171420 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171508 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171728 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.171816 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172030 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172125 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172343 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172429 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172651 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172739 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.172955 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173052 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173268 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173366 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173570 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173659 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173873 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.173958 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174173 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174274 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174477 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174612 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174788 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.174925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.175093 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.175254 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.175558 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.175658 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.175878 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176010 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176184 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176317 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176501 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176814 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.176961 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177109 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177243 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177514 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177652 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177822 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.177973 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178135 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178241 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178441 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178528 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178742 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.178862 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179043 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179169 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179379 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179505 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179701 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.179819 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.180027 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.180182 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.180869 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.180980 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181175 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181292 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181536 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181637 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181844 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.181931 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182165 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182251 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182493 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182589 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182814 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.182908 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183120 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183243 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183475 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183587 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183893 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.183980 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184205 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184300 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184509 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184597 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184836 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.184923 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185160 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185265 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185462 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185552 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.185914 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186092 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186212 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186416 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186505 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186740 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.186839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187051 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187172 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187392 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187494 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187697 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.187785 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188019 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188146 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188341 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188438 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188656 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188743 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.188966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189054 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189292 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189393 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189620 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189707 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.189939 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190026 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190265 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190361 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190590 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190675 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190895 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.190982 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191210 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191312 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191626 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191834 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.191922 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192139 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192228 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192460 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192547 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192765 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.192861 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193076 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193166 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193384 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193473 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193693 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193780 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.193995 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194084 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194297 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194385 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194607 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194702 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194907 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.194995 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.195234 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.195324 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.195545 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.195650 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.195898 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196026 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196206 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196297 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196511 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196606 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196833 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.196920 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197142 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197227 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197447 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197580 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197753 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.197840 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198056 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198144 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198374 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198470 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198682 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.198989 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199077 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199325 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199428 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199653 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199748 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.199963 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200051 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200286 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200374 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200609 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200695 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.200925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201012 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201233 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201327 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201552 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201652 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201856 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.201952 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202157 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202245 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202468 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202565 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202771 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.202868 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203073 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203167 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203401 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203492 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203710 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.203811 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204012 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204101 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204313 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204400 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204615 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204713 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.204922 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205009 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205223 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205309 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205525 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205612 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205830 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.205917 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206137 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206259 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206442 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206563 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206742 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.206843 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207056 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207155 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207390 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207498 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207697 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.207788 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208002 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208102 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208336 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208486 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208628 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208767 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.208956 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209103 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209270 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209407 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209584 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209720 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.209898 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210041 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210192 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210328 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210513 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210650 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210826 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.210976 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211140 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211248 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211503 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211592 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211817 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.211983 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212131 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212221 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212445 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212533 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212760 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.212856 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213077 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213323 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213419 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213652 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213752 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.213967 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214056 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214281 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214554 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214649 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214887 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.214975 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215254 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215345 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215528 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215626 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215842 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.215928 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216153 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216254 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216466 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216576 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216780 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.216878 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217093 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217181 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217408 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217505 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217724 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.217812 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218041 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218135 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218357 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218485 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218672 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218759 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.218983 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219071 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219350 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219454 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219667 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219754 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.219975 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220062 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220288 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220605 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220690 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.220921 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221007 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221232 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221309 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221542 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221626 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221854 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.221940 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222166 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222252 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222479 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222564 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222791 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.222876 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223101 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223177 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223439 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223559 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223766 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.223846 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224100 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224178 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224413 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224489 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224722 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.224821 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225036 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225115 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225353 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225441 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225895 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.225995 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.226213 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.226300 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.226547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.226660 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.226870 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.227687 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228013 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228107 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228350 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228443 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228681 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.228780 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229009 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229098 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229329 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229421 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229638 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229726 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.229957 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230061 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230264 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230360 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230568 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230658 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230883 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.230984 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231211 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231316 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231522 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231613 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231845 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.231944 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.232159 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.232247 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.232463 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.232694 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.232783 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233045 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233145 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233361 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233613 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233702 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.233965 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234286 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234375 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234590 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.234914 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.235005 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.235241 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.235335 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.235807 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.235910 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236123 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236214 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236433 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236533 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236735 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.236833 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237042 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237140 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237351 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237439 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237660 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237757 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.237966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238056 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238276 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238364 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238581 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238715 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238887 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.238983 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239215 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239306 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239519 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239620 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239822 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.239911 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240133 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240223 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240437 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240527 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240740 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.240828 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241045 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241140 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241349 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241445 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241656 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241744 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.241959 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.242048 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.242262 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.242354 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.242582 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.243226 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.243437 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.243527 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.243745 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.243837 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244146 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244370 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244466 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244770 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.244998 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245091 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245301 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245399 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245621 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245710 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.245933 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246024 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246249 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246349 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246567 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246668 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246875 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.246964 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.247235 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.247348 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.247534 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.247625 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.247847 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.248091 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.248216 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.248425 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.248516 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.248747 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249036 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249133 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249377 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249475 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249690 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249779 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.249998 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250087 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250303 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250394 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250629 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250721 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.250939 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251036 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251280 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251407 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251593 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251732 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.251912 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252222 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252313 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252531 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252626 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252844 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.252942 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253155 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253242 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253465 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253552 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253776 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.253872 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254084 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254172 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254394 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254481 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254708 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.254864 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255008 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255178 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255388 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255560 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255726 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.255896 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256070 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256239 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256398 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256747 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256840 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256923 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.256993 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257186 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257293 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257504 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257602 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257825 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.257915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258140 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258254 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258481 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258572 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258793 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.258930 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259107 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259232 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259465 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259572 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259785 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.259899 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260100 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260192 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260411 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260500 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260793 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.260888 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261107 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261199 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261429 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261518 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261751 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.261859 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262065 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262173 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262382 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262479 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262695 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.262784 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263004 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263098 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263360 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263454 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263677 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.263785 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264003 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264091 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264309 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264398 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264612 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264714 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.264916 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265005 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265229 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265319 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265547 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265645 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265849 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.265938 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266150 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266245 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266461 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266552 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266769 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.266857 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267069 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267236 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267400 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267491 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267705 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.267801 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.268008 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.268096 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.268586 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.268692 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.268885 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269012 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269187 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269276 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269486 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269575 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269787 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.269875 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270088 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270190 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270390 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270478 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270694 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270783 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.270996 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271092 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271323 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271416 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271629 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271730 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.271933 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272123 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272235 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272324 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272583 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272679 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272842 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.272946 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273146 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273484 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273573 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273794 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.273891 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274139 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274228 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274454 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274541 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274762 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.274853 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275098 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275233 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275420 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275508 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275729 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.275818 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276051 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276146 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276367 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276457 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276678 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276767 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.276989 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277082 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277302 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277403 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277613 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277701 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.277921 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278009 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278232 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278328 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278548 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278636 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278852 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.278939 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279177 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279306 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279519 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279608 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279825 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.279912 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280146 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280235 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280456 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280544 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280775 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.280864 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281084 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281174 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281394 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281482 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281704 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.281800 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282014 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282104 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282330 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282449 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282640 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282756 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.282948 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283053 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283277 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283375 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283594 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283694 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283901 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.283988 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284214 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284305 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284532 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284619 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284842 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.284919 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285167 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285273 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285489 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285577 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285801 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.285896 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286128 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286216 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286457 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286548 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286785 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.286907 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287110 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287236 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287440 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287552 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287745 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287842 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.287987 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:11:44.288098 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.288411 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.288719 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:11:44.288966 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:11:44.441962 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO dbcounter [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Registered counter for database nova_api Aug 02 10:11:44.443720 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO dbcounter [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Registered counter for database nova_api Aug 02 10:11:44.462516 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.464014 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_db.sqlalchemy.engines [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.469303 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writer thread running {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.470521 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writer thread running {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.526512 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.context [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28ef1aed-d190-4dde-ac75-a293fcede000(cell1) {{(pid=103779) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:11:44.526702 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.context [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28ef1aed-d190-4dde-ac75-a293fcede000(cell1) {{(pid=103780) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:11:44.530471 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:11:44.530630 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_concurrency.lockutils [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:11:44.532602 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:11:44.532697 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_concurrency.lockutils [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:11:44.532935 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:11:44.533040 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_concurrency.lockutils [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:11:44.534924 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:11:44.535032 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_concurrency.lockutils [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:11:44.536957 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO dbcounter [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Registered counter for database nova_cell0 Aug 02 10:11:44.537064 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO dbcounter [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Registered counter for database nova_cell0 Aug 02 10:11:44.543165 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO dbcounter [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Registered counter for database nova_cell1 Aug 02 10:11:44.543470 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO dbcounter [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Registered counter for database nova_cell1 Aug 02 10:11:44.550671 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_db.sqlalchemy.engines [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.552053 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_db.sqlalchemy.engines [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.554416 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.555936 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.558437 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writer thread running {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.562555 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writer thread running {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.563797 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writer thread running {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.564830 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writer thread running {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.708875 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO dbcounter [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Registered counter for database nova_cell0 Aug 02 10:11:44.716761 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_db.sqlalchemy.engines [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.720554 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO dbcounter [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Registered counter for database nova_cell0 Aug 02 10:11:44.721170 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writer thread running {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:44.730423 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:11:44.734978 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writer thread running {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:11:45.108780 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: WARNING keystonemiddleware.auth_token [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:11:45.116846 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: WARNING keystonemiddleware.auth_token [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:11:45.141930 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: WARNING keystonemiddleware.auth_token [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:11:45.149777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: WARNING keystonemiddleware.auth_token [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:11:45.484928 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: WARNING keystonemiddleware.auth_token [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:11:45.490973 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: WARNING keystonemiddleware.auth_token [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:11:45.492023 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: WARNING keystonemiddleware.auth_token [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:11:45.497529 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: WARNING keystonemiddleware.auth_token [None req-9cd6e2cd-2eaf-47ee-877c-396c80be7609 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:11:45.498381 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a20f66a9c0 pid: 103780 (default app) Aug 02 10:11:45.500623 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:11:45.502032 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001989 Aug 02 10:11:45.502473 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Tue Aug 2 10:11:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:11:45.502779 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a20f66a9c0 pid: 103779 (default app) Aug 02 10:13:04.964771 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:04.965793 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 02 10:13:04.966179 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:04.978769 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_api:SELECT=3 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:04.979933 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_cell0:SELECT=3 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:04.980697 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_cell1:SELECT=3 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:04.981465 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:05.884806 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-92e465d8-9c64-41f1-9e92-e3e0009a1cbf admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:05.918609 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-92e465d8-9c64-41f1-9e92-e3e0009a1cbf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945446 Aug 02 10:13:05.919487 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Aug 2 10:13:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:08.128862 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:08.129861 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-e004d844-87c4-4af3-b8ea-b39d950725b8 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 02 10:13:08.130440 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:08.634105 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-36eaafb2-d8c3-46a7-ad15-23a67d8b050a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:08.656909 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:08.656909 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: warnings.warn(msg) Aug 02 10:13:08.731952 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-36eaafb2-d8c3-46a7-ad15-23a67d8b050a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595285 Aug 02 10:13:08.732727 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:13:08.746699 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_api:SELECT=3 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.747657 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_cell0:SELECT=3 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.748754 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_cell1:SELECT=3 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.749494 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.957093 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-87f05fb1-aa00-4cea-b1f8-e703665070ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:08.961482 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:08.961482 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:13:09.074480 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-87f05fb1-aa00-4cea-b1f8-e703665070ad admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333357 Aug 02 10:13:09.075387 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Aug 2 10:13:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:13:11.397058 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-36eaafb2-d8c3-46a7-ad15-23a67d8b050a admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:11.399548 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-36eaafb2-d8c3-46a7-ad15-23a67d8b050a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002919 Aug 02 10:13:11.400243 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:12.070013 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-fe0072af-0721-4726-b228-f43d79ff4aba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:12.089297 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:12.089297 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:13:12.207238 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-fe0072af-0721-4726-b228-f43d79ff4aba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.800924 Aug 02 10:13:12.214461 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:12.221658 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-5d4b2c70-f6ae-4bf5-a774-09d8793444b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:12.225224 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:12.225224 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: warnings.warn(msg) Aug 02 10:13:12.351730 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-5d4b2c70-f6ae-4bf5-a774-09d8793444b4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133929 Aug 02 10:13:12.352596 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Aug 2 10:13:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:14.587351 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-fe0072af-0721-4726-b228-f43d79ff4aba admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:14.588523 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-fe0072af-0721-4726-b228-f43d79ff4aba admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Aug 02 10:13:14.593327 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:15.017813 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-55839760-d2eb-48d6-aabf-43eca7968add admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:15.124290 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-55839760-d2eb-48d6-aabf-43eca7968add admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530045 Aug 02 10:13:15.124893 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:13:15.137123 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-68f9cee9-3ebf-41a4-b76b-1f6f46f4da6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:15.240147 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-68f9cee9-3ebf-41a4-b76b-1f6f46f4da6c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106876 Aug 02 10:13:15.241079 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Aug 2 10:13:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:13:17.473744 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-55839760-d2eb-48d6-aabf-43eca7968add admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:17.474847 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-55839760-d2eb-48d6-aabf-43eca7968add admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Aug 02 10:13:17.475387 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:17.943032 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-fbd56056-f7dc-4a32-9fc3-c7d55fb52eed admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:18.022153 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-fbd56056-f7dc-4a32-9fc3-c7d55fb52eed admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540396 Aug 02 10:13:18.022841 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:18.035532 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-8e4f68d3-8954-4b45-84dc-d6c269bfcde1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:18.106332 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-8e4f68d3-8954-4b45-84dc-d6c269bfcde1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074853 Aug 02 10:13:18.107165 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Aug 2 10:13:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:13:20.347652 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-fbd56056-f7dc-4a32-9fc3-c7d55fb52eed admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:20.348665 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-fbd56056-f7dc-4a32-9fc3-c7d55fb52eed admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 02 10:13:20.349301 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:20.792876 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:20.896786 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541236 Aug 02 10:13:20.904943 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:20.911423 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-9cc9975c-d558-4908-aeea-6845f8c47636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:21.037048 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-9cc9975c-d558-4908-aeea-6845f8c47636 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130622 Aug 02 10:13:21.037617 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Aug 2 10:13:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:23.262876 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:23.263937 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 02 10:13:23.264340 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:23.722433 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-7171f6e0-8707-4a95-a133-75f7135685c9 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:23.748421 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-7171f6e0-8707-4a95-a133-75f7135685c9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477838 Aug 02 10:13:23.749001 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Aug 2 10:13:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:13:26.010372 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:26.011467 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-52c24223-04f4-448b-9083-1ad1998c071a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 02 10:13:26.011864 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:26.467480 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-a379606c-f6d0-456e-9942-083cdfa2abd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 1}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:26.543289 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-a379606c-f6d0-456e-9942-083cdfa2abd9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.525420 Aug 02 10:13:26.543868 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:13:26.556797 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-90a5e671-3630-4162-9029-1236312ac967 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:26.855259 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-90a5e671-3630-4162-9029-1236312ac967 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302745 Aug 02 10:13:26.855844 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Aug 2 10:13:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:13:29.155738 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-a379606c-f6d0-456e-9942-083cdfa2abd9 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:29.156783 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-a379606c-f6d0-456e-9942-083cdfa2abd9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 02 10:13:29.157187 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:29.567163 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-f46a3516-7336-4f36-9c84-f916835ad66b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:29.644668 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-f46a3516-7336-4f36-9c84-f916835ad66b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481299 Aug 02 10:13:29.645144 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:29.657744 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-45ae0bfa-7cc4-42dc-89a7-20a5851b9dd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:29.768991 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-45ae0bfa-7cc4-42dc-89a7-20a5851b9dd1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114849 Aug 02 10:13:29.769558 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Aug 2 10:13:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:32.016187 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-f46a3516-7336-4f36-9c84-f916835ad66b admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:32.017295 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-f46a3516-7336-4f36-9c84-f916835ad66b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 02 10:13:32.018269 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:32.416769 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4ea60e36-8b9c-462a-aac5-cd4373e26627 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:32.490448 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4ea60e36-8b9c-462a-aac5-cd4373e26627 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464895 Aug 02 10:13:32.491011 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:32.502957 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-4df97efb-7ff6-4569-bc2a-96a04568fb40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:32.592777 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-4df97efb-7ff6-4569-bc2a-96a04568fb40 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093465 Aug 02 10:13:32.593346 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Aug 2 10:13:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:34.840995 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4ea60e36-8b9c-462a-aac5-cd4373e26627 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:34.842635 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4ea60e36-8b9c-462a-aac5-cd4373e26627 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Aug 02 10:13:34.843037 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:35.294162 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-a2fe78bc-d646-4d36-9d72-90b1b13b0992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:35.301192 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:35.393978 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-a2fe78bc-d646-4d36-9d72-90b1b13b0992 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544453 Aug 02 10:13:35.394549 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:35.407977 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-085fe721-08dd-415e-8d8f-d952c1a9cbda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:35.496436 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-085fe721-08dd-415e-8d8f-d952c1a9cbda admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092313 Aug 02 10:13:35.497570 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Aug 2 10:13:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:37.776419 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-a2fe78bc-d646-4d36-9d72-90b1b13b0992 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:37.778093 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-a2fe78bc-d646-4d36-9d72-90b1b13b0992 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Aug 02 10:13:37.778729 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:38.297795 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "id": "5", "name": "m1.xlarge", "vcpus": 8}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:38.422256 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.637520 Aug 02 10:13:38.422785 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Aug 2 10:13:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:38.435021 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-c16484a6-f1e0-41ec-8a33-f1bdc60aeba7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:13:38.550217 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-c16484a6-f1e0-41ec-8a33-f1bdc60aeba7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118670 Aug 02 10:13:38.551590 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Aug 2 10:13:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:13:59.956510 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:59.957522 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 02 10:13:59.957933 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:00.356951 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-f38cd953-b392-4aed-b2a0-ed9c589f6530 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:00.375267 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-f38cd953-b392-4aed-b2a0-ed9c589f6530 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411313 Aug 02 10:14:00.375741 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Aug 2 10:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:01.448097 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:01.449094 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4f74aab5-a20d-4b22-b46f-6c5110e7aa2d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 02 10:14:01.449482 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:01.981596 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-b8635b52-1cce-463a-81d0-f26d256a4eda admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:01.987143 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.wsgi [None req-b8635b52-1cce-463a-81d0-f26d256a4eda admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-b8635b52-1cce-463a-81d0-f26d256a4eda admin admin] Request method failure captured: Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept: application/json Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept-Encoding: gzip, deflate Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Connection: keep-alive Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Content-Length: 0 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Host: 10.222.0.49 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-System-Scope: None Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: User-Agent: python-novaclient Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Auth-Token: gAAAAABi6PjpDJ47lb_PpFPRdBhHxUF9SEO6dngbDEf_1z8uJadvIXv-0Cdmvu-l26Xu2qUQ1peMXMPJ_nnpck57NwA8Oli9r-5aWaX_u_ajLcn7kt2jM5orXxQIbrXx2Rq4vBQp5b5bRSOClBVxrwVSuMjDPEGvp33BOzHsY-tQPgdikkqARbs Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Id: None Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Name: None Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Identity-Status: Confirmed Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Is-Admin-Project: True Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Id: default Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Name: Default Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Name: admin Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Role: reader,member,admin Aug 02 10:14:01.990724 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Roles: reader,member,admin Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant: admin Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Name: admin Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User: admin Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Id: default Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Name: Default Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Name: admin Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: method: > Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: exception: Flavor 42 could not be found. Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: action_args: {'id': '42'} Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:01.992562 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:01.995225 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:01.996530 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-b8635b52-1cce-463a-81d0-f26d256a4eda admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:01.997703 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-b8635b52-1cce-463a-81d0-f26d256a4eda admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405747 Aug 02 10:14:01.997703 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Aug 2 10:14:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:02.002368 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-a202aff4-5ae3-4562-966b-dae654922922 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:02.006593 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:02.025913 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-a202aff4-5ae3-4562-966b-dae654922922 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027131 Aug 02 10:14:02.026458 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:02.036397 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9b4b44d9-bf10-430a-a31c-9a8e35d646c3 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:02.060897 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9b4b44d9-bf10-430a-a31c-9a8e35d646c3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028158 Aug 02 10:14:02.061371 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:14:02.070701 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-629fd18a-bcb8-4905-8ef4-ce62422cb174 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:02.076979 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.wsgi [None req-629fd18a-bcb8-4905-8ef4-ce62422cb174 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-629fd18a-bcb8-4905-8ef4-ce62422cb174 admin admin] Request method failure captured: Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept: application/json Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept-Encoding: gzip, deflate Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Connection: keep-alive Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Content-Length: 0 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Host: 10.222.0.49 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-System-Scope: None Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: User-Agent: python-novaclient Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Auth-Token: gAAAAABi6PjpDJ47lb_PpFPRdBhHxUF9SEO6dngbDEf_1z8uJadvIXv-0Cdmvu-l26Xu2qUQ1peMXMPJ_nnpck57NwA8Oli9r-5aWaX_u_ajLcn7kt2jM5orXxQIbrXx2Rq4vBQp5b5bRSOClBVxrwVSuMjDPEGvp33BOzHsY-tQPgdikkqARbs Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Id: None Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Name: None Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Identity-Status: Confirmed Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Is-Admin-Project: True Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Id: default Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Name: Default Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Name: admin Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Role: reader,member,admin Aug 02 10:14:02.080445 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Roles: reader,member,admin Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant: admin Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Name: admin Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User: admin Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Id: default Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Name: Default Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Name: admin Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: method: > Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: exception: Flavor 42 could not be found. Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: action_args: {'id': '42'} Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:02.082003 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:02.082839 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:02.088191 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-629fd18a-bcb8-4905-8ef4-ce62422cb174 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:02.089419 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-629fd18a-bcb8-4905-8ef4-ce62422cb174 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014771 Aug 02 10:14:02.089419 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Aug 2 10:14:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:03.056220 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9b4b44d9-bf10-430a-a31c-9a8e35d646c3 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:03.058010 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9b4b44d9-bf10-430a-a31c-9a8e35d646c3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Aug 02 10:14:03.058408 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:03.594170 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-8a5c759c-1ff0-4f3a-ae7a-11da4c71ecd8 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:03.599503 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.wsgi [None req-8a5c759c-1ff0-4f3a-ae7a-11da4c71ecd8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-8a5c759c-1ff0-4f3a-ae7a-11da4c71ecd8 admin admin] Request method failure captured: Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept: application/json Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept-Encoding: gzip, deflate Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Connection: keep-alive Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Content-Length: 0 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Host: 10.222.0.49 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-System-Scope: None Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: User-Agent: python-novaclient Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Auth-Token: gAAAAABi6PjqtnO15B2OZge5zHKbD7nxJs57yPE_KUPzokeV1VZ_kT5dqDzRrdhlwYYO5KNcawBmzheFz3J41b-Bayu8TAvdDQY0NzMS2h5FbAEmeTFbksIyEy_g2sEZaUCdmXcWiZHt1gEc6J7fDh2-16m0CvypIpGXFFzdo4ZixNC0IV-rkcs Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Id: None Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Name: None Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Identity-Status: Confirmed Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Is-Admin-Project: True Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Id: default Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Name: Default Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Name: admin Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Role: reader,member,admin Aug 02 10:14:03.601027 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Roles: reader,member,admin Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant: admin Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Name: admin Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User: admin Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Id: default Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Name: Default Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Name: admin Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: method: > Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: exception: Flavor 84 could not be found. Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: action_args: {'id': '84'} Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:03.602633 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:03.604267 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.605680 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-8a5c759c-1ff0-4f3a-ae7a-11da4c71ecd8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:03.606931 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-8a5c759c-1ff0-4f3a-ae7a-11da4c71ecd8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404964 Aug 02 10:14:03.606931 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Aug 2 10:14:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:03.612723 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7148136e-e6d0-41d2-905f-78df7851dacd admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:03.628050 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7148136e-e6d0-41d2-905f-78df7851dacd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019008 Aug 02 10:14:03.628583 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:03.639596 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-bc4b1a76-219c-4ec9-9651-108a9fd42ada admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:03.658767 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-bc4b1a76-219c-4ec9-9651-108a9fd42ada admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024251 Aug 02 10:14:03.659351 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:03.669544 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-1112a2af-91a1-41d4-884e-b47a734cf05b admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:03.674873 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.wsgi [None req-1112a2af-91a1-41d4-884e-b47a734cf05b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-1112a2af-91a1-41d4-884e-b47a734cf05b admin admin] Request method failure captured: Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept: application/json Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept-Encoding: gzip, deflate Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Connection: keep-alive Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Content-Length: 0 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Host: 10.222.0.49 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-System-Scope: None Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: User-Agent: python-novaclient Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Auth-Token: gAAAAABi6PjqtnO15B2OZge5zHKbD7nxJs57yPE_KUPzokeV1VZ_kT5dqDzRrdhlwYYO5KNcawBmzheFz3J41b-Bayu8TAvdDQY0NzMS2h5FbAEmeTFbksIyEy_g2sEZaUCdmXcWiZHt1gEc6J7fDh2-16m0CvypIpGXFFzdo4ZixNC0IV-rkcs Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Id: None Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Name: None Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Identity-Status: Confirmed Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Is-Admin-Project: True Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Id: default Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Name: Default Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Name: admin Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Role: reader,member,admin Aug 02 10:14:03.676402 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Roles: reader,member,admin Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant: admin Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Name: admin Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User: admin Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Id: default Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Name: Default Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Name: admin Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: method: > Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: exception: Flavor 84 could not be found. Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: action_args: {'id': '84'} Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:03.677915 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:03.678712 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:03.680057 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-1112a2af-91a1-41d4-884e-b47a734cf05b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:03.681273 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-1112a2af-91a1-41d4-884e-b47a734cf05b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012377 Aug 02 10:14:03.681273 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Aug 2 10:14:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 10:14:04.646441 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-bc4b1a76-219c-4ec9-9651-108a9fd42ada admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:04.647484 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-bc4b1a76-219c-4ec9-9651-108a9fd42ada admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 02 10:14:04.647910 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:05.176852 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-99eca392-210f-401e-8f33-e2c0f44b89ed admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:05.183047 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.wsgi [None req-99eca392-210f-401e-8f33-e2c0f44b89ed admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-99eca392-210f-401e-8f33-e2c0f44b89ed admin admin] Request method failure captured: Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept: application/json Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Accept-Encoding: gzip, deflate Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Connection: keep-alive Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Content-Length: 0 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Host: 10.222.0.49 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Openstack-System-Scope: None Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: User-Agent: python-novaclient Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Auth-Token: gAAAAABi6Pjs1g6j0JwISuP-e23OU6WBVRFYoZvyAkaN-lnzturlaolZ4-Z6dpeDkgF9RWU8J2a-3P_832NS1N48Vvs1tI43WZGTNAp5tLy-9wIcoknv9z41-KNdnubCIKL7HXaDe8SaInxn6ADim142RMUcqa8NO1zhApZ0HDFuKkWSqdD8Vd0 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Id: None Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Domain-Name: None Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Identity-Status: Confirmed Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Is-Admin-Project: True Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Id: default Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Domain-Name: Default Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Project-Name: admin Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Role: reader,member,admin Aug 02 10:14:05.184564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Roles: reader,member,admin Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant: admin Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-Tenant-Name: admin Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User: admin Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Id: default Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Domain-Name: Default Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: X-User-Name: admin Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: method: > Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: exception: Flavor 451 could not be found. Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: action_args: {'id': '451'} Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:05.186129 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:05.187236 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.188646 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-99eca392-210f-401e-8f33-e2c0f44b89ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:05.189925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-99eca392-210f-401e-8f33-e2c0f44b89ed admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399933 Aug 02 10:14:05.189925 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:14:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:05.195696 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-8ecba57f-0ef3-4f04-8283-c526a01b2835 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:05.211068 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-8ecba57f-0ef3-4f04-8283-c526a01b2835 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018972 Aug 02 10:14:05.211620 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:05.221158 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:05.236194 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018587 Aug 02 10:14:05.236722 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Aug 2 10:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:05.246910 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-7b26ab9b-91d3-4889-b641-390217b70ebb admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:05.252401 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.wsgi [None req-7b26ab9b-91d3-4889-b641-390217b70ebb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-7b26ab9b-91d3-4889-b641-390217b70ebb admin admin] Request method failure captured: Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept: application/json Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Accept-Encoding: gzip, deflate Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Connection: keep-alive Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Content-Length: 0 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Host: 10.222.0.49 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-Api-Version: compute 2.90 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Openstack-System-Scope: None Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: User-Agent: python-novaclient Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Auth-Token: gAAAAABi6Pjs1g6j0JwISuP-e23OU6WBVRFYoZvyAkaN-lnzturlaolZ4-Z6dpeDkgF9RWU8J2a-3P_832NS1N48Vvs1tI43WZGTNAp5tLy-9wIcoknv9z41-KNdnubCIKL7HXaDe8SaInxn6ADim142RMUcqa8NO1zhApZ0HDFuKkWSqdD8Vd0 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Id: None Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Domain-Name: None Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Identity-Status: Confirmed Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Is-Admin-Project: True Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Id: default Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Domain-Name: Default Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Project-Name: admin Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Role: reader,member,admin Aug 02 10:14:05.257219 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Roles: reader,member,admin Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/737b03aeb0594b48a03adad9f790a347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_737b03aeb0594b48a03adad9f790a347", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant: admin Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Id: 737b03aeb0594b48a03adad9f790a347 Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-Tenant-Name: admin Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User: admin Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Id: default Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Domain-Name: Default Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Id: f7156356453b494e8893e4adc4a9ad81 Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: X-User-Name: admin Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: method: > Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: exception: Flavor 451 could not be found. Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: action_args: {'id': '451'} Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:14:05.258916 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:05.259946 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: ERROR nova.api.openstack.wsgi Aug 02 10:14:05.261298 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-7b26ab9b-91d3-4889-b641-390217b70ebb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:14:05.262504 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-7b26ab9b-91d3-4889-b641-390217b70ebb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012613 Aug 02 10:14:05.262504 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:14:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:06.225920 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:06.226935 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 02 10:14:06.227364 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:06.748214 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-d323a39b-20d2-4b6c-9f77-857fa1851611 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:14:06.845276 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-d323a39b-20d2-4b6c-9f77-857fa1851611 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.480693 Aug 02 10:14:06.845834 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Aug 2 10:14:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:14:07.833284 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:07.834292 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 02 10:14:07.834693 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:08.366969 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-7f1b7499-b79e-4c68-ae11-0e6e1c4bbbe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:14:08.451119 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-7f1b7499-b79e-4c68-ae11-0e6e1c4bbbe2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.471982 Aug 02 10:14:08.451707 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Aug 2 10:14:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:14:09.421564 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:09.422601 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 02 10:14:09.422991 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:09.965322 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-36211894-8c7b-4371-a3c4-8656fe7bf4e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:14:10.051651 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-36211894-8c7b-4371-a3c4-8656fe7bf4e4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.486348 Aug 02 10:14:10.052205 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Aug 2 10:14:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:14:11.037486 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:11.038527 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 02 10:14:11.038930 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:11.565934 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-1c21b8af-f90c-41cd-af42-8484734443c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:14:11.667463 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-1c21b8af-f90c-41cd-af42-8484734443c5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.490640 Aug 02 10:14:11.668025 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Aug 2 10:14:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:14:12.645106 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:12.646107 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 02 10:14:12.646496 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:13.183340 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-fd054010-20a0-4265-bfe9-aba99ec4472a admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:13.205485 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-fd054010-20a0-4265-bfe9-aba99ec4472a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.423479 Aug 02 10:14:13.206030 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Tue Aug 2 10:14:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:15:05.190919 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.192000 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-7a6a71f9-04f0-4155-b47b-4815e3106779 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 02 10:15:05.192380 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:15:05.203592 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:05.588041 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-532ba7cc-c96b-4125-87b9-bfc96592fcf1 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.609278 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-532ba7cc-c96b-4125-87b9-bfc96592fcf1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410872 Aug 02 10:15:05.615324 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:15:05.631055 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG dbcounter [-] [103779] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:05.634877 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-6ebaec7b-d230-42b2-bf3b-78f700b48593 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.642608 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-6ebaec7b-d230-42b2-bf3b-78f700b48593 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013060 Aug 02 10:15:05.643442 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:15:05.655559 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-63edc699-4e51-4196-aa3c-9369cdd5d90f admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.663273 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-63edc699-4e51-4196-aa3c-9369cdd5d90f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012049 Aug 02 10:15:05.663784 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:15:05.675746 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.683927 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011741 Aug 02 10:15:05.684445 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:15:05.695832 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-dbc6710d-4a0c-48a0-bf70-321a45d93278 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:15:05.707419 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-dbc6710d-4a0c-48a0-bf70-321a45d93278 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015292 Aug 02 10:15:05.707965 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Aug 2 10:15:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:01.932193 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:01.933571 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001884 Aug 02 10:19:01.934024 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:02.075582 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_api:SELECT=6 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:02.252869 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:02.256925 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:19:02.256925 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:19:02.259053 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.259889 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.261247 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.261995 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.299296 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4acc6030-8d30-44db-aaec-4449deb1155b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.225098 Aug 02 10:19:02.299884 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:19:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:19:03.211762 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.213218 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 Aug 02 10:19:03.213783 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:03.421792 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.424557 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:19:03.424557 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:19:03.426162 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.426695 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.427630 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.428108 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.450759 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-4d939be4-efba-4e61-a104-7e975dfcaa7b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088103 Aug 02 10:19:03.451384 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:19:14.764868 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:14.766074 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002150 Aug 02 10:19:14.766473 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:14.916806 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_cell0:SELECT=4 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:14.917543 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_cell1:SELECT=4 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:14.918171 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG dbcounter [-] [103780] Writing DB stats nova_api:SELECT=8 {{(pid=103780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:14.971043 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:14.976899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:19:14.976899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:19:14.976899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.976899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:14.976899 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.977690 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.004617 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-1f51879d-23c1-4df3-bbaf-3cf3a54c9a21 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093246 Aug 02 10:19:15.005206 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:19:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:19:15.868616 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: DEBUG nova.api.openstack.wsgi [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] Calling method '>' {{(pid=103779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:15.869981 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: INFO nova.api.openstack.requestlog [None req-9ba47ec8-a22e-49a2-b352-88b62af91e14 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 Aug 02 10:19:15.870518 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: [pid: 103779|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Aug 2 10:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:16.090580 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG nova.api.openstack.wsgi [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] Calling method '>' {{(pid=103780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:16.093250 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:19:16.093250 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: warnings.warn(msg) Aug 02 10:19:16.094683 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:16.095133 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:16.095993 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:16.096426 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: DEBUG oslo_concurrency.lockutils [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:16.121864 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: INFO nova.api.openstack.requestlog [None req-2832d3c9-2f1c-489c-ba3d-9fdbbf902594 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.106271 Aug 02 10:19:16.122459 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: [pid: 103780|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Aug 2 10:19:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:16.012608 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: Tue Aug 2 10:20:16 2022 - graceful shutdown triggered... Aug 02 10:20:16.012833 dv-cinder-847536-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 10:20:16.013944 dv-cinder-847536-4-iscsi devstack@n-api.service[103780]: Gracefully killing worker 2 (pid: 103780)... Aug 02 10:20:16.014361 dv-cinder-847536-4-iscsi devstack@n-api.service[103779]: Gracefully killing worker 1 (pid: 103779)... Aug 02 10:20:17.015054 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: worker 1 buried after 1 seconds Aug 02 10:20:17.015682 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: worker 2 buried after 1 seconds Aug 02 10:20:17.015682 dv-cinder-847536-4-iscsi devstack@n-api.service[103778]: goodbye to uWSGI. Aug 02 10:20:17.016663 dv-cinder-847536-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 10:20:17.017225 dv-cinder-847536-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 10:20:17.020160 dv-cinder-847536-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:20:17.031821 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:20:17.033982 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:20:17 2022] *** Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: nodename: dv-cinder-847536-4-iscsi Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: machine: x86_64 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: clock source: unix Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: pcre jit disabled Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: detected number of CPU cores: 4 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: current working directory: / Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: your processes number limit is 47680 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: your memory page size is 4096 bytes Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: detected max file descriptor number: 2048 Aug 02 10:20:17.034107 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: lock engine: pthread robust mutexes Aug 02 10:20:17.035010 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: thunder lock: enabled Aug 02 10:20:17.035010 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:20:17.035010 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:20:17.074047 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: Python main interpreter initialized at 0x5563daa279c0 Aug 02 10:20:17.074047 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: python threads support enabled Aug 02 10:20:17.074047 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: your server socket listen backlog is limited to 100 connections Aug 02 10:20:17.074047 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:20:17.074498 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:20:17.074498 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: *** Operational MODE: preforking *** Aug 02 10:20:17.074785 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:20:17.074785 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: spawned uWSGI master process (pid: 118438) Aug 02 10:20:17.075012 dv-cinder-847536-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:20:17.075580 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: spawned uWSGI worker 1 (pid: 118452, cores: 1) Aug 02 10:20:17.076126 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: spawned uWSGI worker 2 (pid: 118453, cores: 1) Aug 02 10:20:17.076434 dv-cinder-847536-4-iscsi devstack@n-api.service[118438]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:20:17.744078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:20:17.756406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:20:18.908662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:20:18.908662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: from cryptography.utils import int_from_bytes Aug 02 10:20:18.909325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:20:18.909325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: from cryptography.utils import int_from_bytes Aug 02 10:20:18.920211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:20:18.920211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: from cryptography.utils import int_from_bytes Aug 02 10:20:18.920786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:20:18.920786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: from cryptography.utils import int_from_bytes Aug 02 10:20:21.359433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:20:21.360079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:20:21.360435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:20:21.360522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:20:21.360621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:20:21.360713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:20:21.360792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:20:21.360893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:20:21.360977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:20:21.361060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:20:21.361416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.361523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.361523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.361675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.361842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.361944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.362963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.363156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.363266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.363517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.364944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.365150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.365265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-4-iscsi {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.365482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-4-iscsi {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.365594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.365814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.366930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.367040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.367273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.367432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.367611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.367928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.368122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.368250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.368573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.368950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.369155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.369377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.369491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.369799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.369918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.370915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.371086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.371311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.371655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.371764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-4-iscsi {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.372823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-4-iscsi {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.373836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.374867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.375861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.376834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.377985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.378965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.379178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.379962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.380952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.381945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.382933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.383905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.384848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.385836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.386993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.387983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.388949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.389976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.390202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.390294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.390528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.390630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.390781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.391786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.392946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.393876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.394934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.395150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.395321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.395545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.395672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.395782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.396981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.396981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.397914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.398996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.399085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.399176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.400997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.401990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.402936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.403840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.404975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.405289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.405393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.405665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.405780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.405917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.406861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.407110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.407283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.407480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.407616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:20:21.407833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.407926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.408922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.409898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.410906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.411902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.412942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.413839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.414804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.415863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.416816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.417997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.418970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.419960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.420919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.421972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.422938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.423905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.424843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.425836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.426027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.426645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.426870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.427922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.428866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.429946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.430039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.430353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.430668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.430989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.431347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.431509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.431699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.431988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.432131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.432319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.432620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.432719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.432953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.433932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.434915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.435939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.436862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.437777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.438920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.439030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.439210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.439375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.439516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.439946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.440934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.441034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.441272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.441364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.441587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.441741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.442002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.442852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.442991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.443246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.443390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.443544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.443867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.444924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.445886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.446977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.447861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.448947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.449997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.450311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.450408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.450625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.450749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.450945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.451912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.452929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.453931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.454853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.455835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.456787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.458966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.459106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.459637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.459789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.459922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.460051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.460179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.460318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.461215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.461360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.461491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.461621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.462689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.462846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.463930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.464943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.465926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.466913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.467883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468427 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.468982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.469831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.470839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.471057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.471170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.471401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.471496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.471725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.472826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.473509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.473615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.473849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.473958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.474994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.475220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.475348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.475648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.475876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.476917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.477891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.478107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.478445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.478677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.478940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.479172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.479385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.479540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.479699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.479854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.480959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.481899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.482945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.483996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.484327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.484553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.484649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.484743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.484830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.485847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.486969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.487967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.488182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.488337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.488483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.488690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.489312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.489471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.489570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.489758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.489856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.490802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.491795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.492948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.493898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.494919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.495893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.496850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.497982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.498936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.499038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.499268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.504908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.505019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.505125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.505213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.512147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.512451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.512622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.513040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.513329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.513595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.513890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.514159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.514430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.514679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.514933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.515287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.515519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.515674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.515840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.515987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.516905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.517933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.518827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.519118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.519303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.519303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.519660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.519805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.520575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.521228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.521426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.521583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.521729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.521882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.522948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.523885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.524031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.524182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.524353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.524840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.525971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.526126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.526271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.532317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.533884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.534954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.535072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.535318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.535439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.542279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.542466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.542623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.542807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.542974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.543142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.543376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.543540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.543710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.543883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.544990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.545181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.545425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.545672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.545916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.546167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.546424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.546693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.546693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.547370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.547370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.547854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.548131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.548385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.548637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.548898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.549164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.549416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.549704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.549958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.550217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.550476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.550887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.551154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.552313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.552582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.552582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.553073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.553334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.553647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.553919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.554187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.554444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.554707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.554958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.555373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.555631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.555891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.555891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.556375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.556634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.556904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.557161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.557422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.557698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.557947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.558211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.558481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.558919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.559206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.559466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.559722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.559981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.560247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.560524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.560774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.561151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.561494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.561770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.562020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.562020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.562655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.562922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.563169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.563483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.563751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.564053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.564319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.564568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.564848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.565110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.565371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.565630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.565895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.566157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.566407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.566740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.567057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.567358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.567622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.567896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.568157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.568431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.568676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.568937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.569185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.569453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.569699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.569949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.570309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.570574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.570838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.571129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.571534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.571793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.572068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.572329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.572329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.572993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.573244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.573508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.573768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.574030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.574296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.574542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.574789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.575027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.575310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.575796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.576068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.576333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.576584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.576871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.577122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.577387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.577639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.577900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.578143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.578402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.578662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.578946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.579224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.579496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.579741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.579997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.580251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.580513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.580759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.581014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.581258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.581542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.581888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.582150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.582454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.582735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.583022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.583423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.583672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.583946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.584207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.584462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.584704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.584955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.585210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.585457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.585784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.586051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.586311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.586573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.586573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.587042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.587388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.587640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.587887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.588126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.588390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.588636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.588890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.589152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.589400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.589666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.589666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.590155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.590399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.590655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.590912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.591244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.591506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.591761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.592364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.592775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.593056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.593425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.593836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.594090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.594342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.594605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.594806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.594982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.595146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.595360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.595660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.595917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.596177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.596453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.596705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.596954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.597200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.597444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.597717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.597961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.598828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.599082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.599355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.599599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.599869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.600124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.600398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.600656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.601343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.601602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.601872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.602120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.602520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.602776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.603020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.603320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.603584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.603866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.604235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.604411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.604628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.604895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.605142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.605395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.605643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.605905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.606148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.606409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.606668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.606921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.607177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.607497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.607736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.607913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.608161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.608408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.608657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.608908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.609402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.609676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.609676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.610172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.610385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.610609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.610890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.611150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.611458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.611711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.611963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.612222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.612509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.612890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.613146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.613497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.616946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.617918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.618928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.619963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.620926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.621897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622295 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.622972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.623945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.624917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625097 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.625983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.626947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.627936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.628936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.629950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.630940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.631947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.632938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.633943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.634903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.635926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.636915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.637941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.638978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.639947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.640904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.641989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.642937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.643906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.644969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.645936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.646893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.647927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.648869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.649965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.650924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.651894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.652820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.653886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.654970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.655992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.656941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.657871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.658927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.659776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.660041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.660181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.660321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.660321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.661117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.661433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.661570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.661887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.662121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.662346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.662689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.662834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.664408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.664408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.664695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.664849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.665851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.666172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.666376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.666661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.666978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.667258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.667669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.667820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.668124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.668267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.668567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.668763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.668940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:20:21.669335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.669950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.670543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.671159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.671815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.672434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.673062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.673690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.674197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.674823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.675774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.677855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.678482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.679154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.679805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.680210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.680793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.681389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:20:21.681853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:20:21.733373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO dbcounter [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Registered counter for database nova_api Aug 02 10:20:21.755136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_db.sqlalchemy.engines [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.764542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writer thread running {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:21.812008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Registered counter for database nova_api Aug 02 10:20:21.821000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.context [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28ef1aed-d190-4dde-ac75-a293fcede000(cell1) {{(pid=118452) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:20:21.825229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.826852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.827688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.829737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.831765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO dbcounter [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Registered counter for database nova_cell0 Aug 02 10:20:21.836597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO dbcounter [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Registered counter for database nova_cell1 Aug 02 10:20:21.842598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.844160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_db.sqlalchemy.engines [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.845534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_db.sqlalchemy.engines [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.850927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:21.852622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writer thread running {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:21.854688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writer thread running {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:21.912552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.context [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28ef1aed-d190-4dde-ac75-a293fcede000(cell1) {{(pid=118453) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:20:21.916714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.918340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.919133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.921179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.923399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Registered counter for database nova_cell0 Aug 02 10:20:21.927594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Registered counter for database nova_cell1 Aug 02 10:20:21.934801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.937132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:21.941829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:22.003686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO dbcounter [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Registered counter for database nova_cell0 Aug 02 10:20:22.010679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_db.sqlalchemy.engines [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:22.015325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writer thread running {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:22.080623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:22.092473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Registered counter for database nova_cell0 Aug 02 10:20:22.100382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:20:22.105300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:20:22.339778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: WARNING keystonemiddleware.auth_token [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:20:22.347366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: WARNING keystonemiddleware.auth_token [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:20:22.425551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:20:22.432945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:20:22.701547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: WARNING keystonemiddleware.auth_token [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:20:22.707834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: WARNING keystonemiddleware.auth_token [None req-06e7f203-5f0b-4bf8-b971-68f0ecf37329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:20:22.713365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563daa279c0 pid: 118452 (default app) Aug 02 10:20:22.782937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:20:22.789057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-a35f3a7f-233e-407e-83b3-8aa008d96ce8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:20:22.794398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563daa279c0 pid: 118453 (default app) Aug 02 10:21:05.122975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:05.125708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:05.127481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:05.129817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.055608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.062532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.063828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.066246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.485232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7bedd382-d936-4b22-85a6-9f44b85f483c tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Action: 'create', calling method: .version_select at 0x7f70c8c3bee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1860139076"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:07.405667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b7909e39-83b5-4a38-bc9c-029ba765b707 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Action: 'create', calling method: .version_select at 0x7f70c8c38ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-649314852", "metadata": {"Type": "work"}}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:09.229354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7bedd382-d936-4b22-85a6-9f44b85f483c tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.111747 Aug 02 10:21:09.239969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Aug 2 10:21:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4114 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 10:21:09.260020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7393981c-3bbb-4184-be3c-81bab41697ee tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a1ad30>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:09.461556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b7909e39-83b5-4a38-bc9c-029ba765b707 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.414291 Aug 02 10:21:09.462360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1156 bytes} [Tue Aug 2 10:21:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3417 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 10:21:09.467504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a800d17-13be-4ff4-acc7-4cebac34a8e8 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c8a1ad30>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:09.511494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7393981c-3bbb-4184-be3c-81bab41697ee tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.265550 Aug 02 10:21:09.514805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:09 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:09.537543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69677cd6-2008-48f1-bf45-02adcbd0dd6e tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2a430>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:09.598802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a800d17-13be-4ff4-acc7-4cebac34a8e8 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0a3a00b7-880f-41d1-9ee1-301f939d5741" status: 200 len: 350 microversion: 2.1 time: 0.135171 Aug 02 10:21:09.599507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:09 2022] GET /compute/v2.1/os-volumes/0a3a00b7-880f-41d1-9ee1-301f939d5741 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:09.747880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69677cd6-2008-48f1-bf45-02adcbd0dd6e tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 352 microversion: 2.1 time: 0.231870 Aug 02 10:21:09.748839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:09 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 352 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:10.530408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7aef3d72-59f7-4680-afcc-4963fbfe6f4a tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2c4c0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:10.762645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9ada591b-705a-4744-ab87-b83cf3447566 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2ab80>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:10.976316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7aef3d72-59f7-4680-afcc-4963fbfe6f4a tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 346 microversion: 2.1 time: 0.453212 Aug 02 10:21:10.977060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:10 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 346 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:10.990506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11d54156-1092-4f28-8e94-d1a82b36630b tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Action: 'create', calling method: .version_select at 0x7f70c8a2cb80>, body: {"snapshot": {"volume_id": "f2ad75ef-ae2c-4446-afa7-069480cfe151", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1700127027"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:11.057432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9ada591b-705a-4744-ab87-b83cf3447566 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 353 microversion: 2.1 time: 0.299172 Aug 02 10:21:11.058073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:10 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:11.073124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cac87fad-f81a-4d00-8c14-d6b90bd6390b tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2ad30>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:11.685404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cac87fad-f81a-4d00-8c14-d6b90bd6390b tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 353 microversion: 2.1 time: 0.617871 Aug 02 10:21:11.686645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:11 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 353 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:11.705078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d7b27ab8-e596-4823-ad72-1bc71a67bc82 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2a4c0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:11.900938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11d54156-1092-4f28-8e94-d1a82b36630b tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.914815 Aug 02 10:21:11.902376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 4/9] 10.222.0.49 () {60 vars in 1162 bytes} [Tue Aug 2 10:21:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:11.913287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2eeefcb6-8a5f-4aa2-9a4c-7fd18acc75be tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2ce50>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.078653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2eeefcb6-8a5f-4aa2-9a4c-7fd18acc75be tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 287 microversion: 2.1 time: 0.169592 Aug 02 10:21:12.079575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:11 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:12.091921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4bab656b-7cf9-49ff-bd21-04706315fdd8 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2c670>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.204661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d7b27ab8-e596-4823-ad72-1bc71a67bc82 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 202 len: 0 microversion: 2.1 time: 0.503319 Aug 02 10:21:12.206911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:21:11 2022] DELETE /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:21:12.216567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2cfbbe14-f032-407d-91d6-0efb064916c8 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a1aee0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.357373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4bab656b-7cf9-49ff-bd21-04706315fdd8 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.269903 Aug 02 10:21:12.357958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1140 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:12.370300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ab60dc93-288c-427e-a9f0-987c00f7f112 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c8a331f0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.484060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2cfbbe14-f032-407d-91d6-0efb064916c8 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 352 microversion: 2.1 time: 0.272643 Aug 02 10:21:12.486647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 352 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:12.492607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b3b52200-7f19-4089-a57a-0245681da512 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a1adc0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.542159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ab60dc93-288c-427e-a9f0-987c00f7f112 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1eb698f1-36ef-4ea0-a1f9-b4eb6fb57b74" status: 200 len: 351 microversion: 2.1 time: 0.182894 Aug 02 10:21:12.548656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/os-volumes/1eb698f1-36ef-4ea0-a1f9-b4eb6fb57b74 => generated 351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:12.589382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b3b52200-7f19-4089-a57a-0245681da512 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 287 microversion: 2.1 time: 0.101165 Aug 02 10:21:12.594643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:13.504489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fca6ac64-37aa-4eb6-b5f2-482044334d5c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c93a0310>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:13.602437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-df97e047-d070-4319-a262-5104dfdad56d tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2a670>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:13.677537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fca6ac64-37aa-4eb6-b5f2-482044334d5c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 352 microversion: 2.1 time: 0.181302 Aug 02 10:21:13.684935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:13 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 352 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:13.731116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-df97e047-d070-4319-a262-5104dfdad56d tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 287 microversion: 2.1 time: 0.131338 Aug 02 10:21:13.732538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:13 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:14.694490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-248f71e7-663f-4c41-b94c-87495463dac5 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2c700>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:14.746866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b852c748-4654-4693-b369-721a94de5ab2 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2aca0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:14.779410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-248f71e7-663f-4c41-b94c-87495463dac5 tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 352 microversion: 2.1 time: 0.091390 Aug 02 10:21:14.780114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:14 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:14.798492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b852c748-4654-4693-b369-721a94de5ab2 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 287 microversion: 2.1 time: 0.057013 Aug 02 10:21:14.801258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 10/19] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:14 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:15.722914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22d61614-5309-4762-867b-f1f997c284ae tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: .version_select at 0x7f70c8a2caf0>, body: {"keypair": {"name": "tempest-keypair-390253294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvbQdWaqUsMT8Jw6ZUGhORhr2fnAcbUjhLNxLKRUYUclT+aYGkYupz+sJeOU3vWWt80wU2gmatvfuNGXPyzeYJI38VjtssjuFuRpVW7bQWMNETps6nkYtDzFagJLx+vfQ=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:15.794502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-def5fffc-213f-4d10-b812-3e37b65f3d1a tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a2af70>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:15.806545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-22d61614-5309-4762-867b-f1f997c284ae tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:21:15.825678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-22d61614-5309-4762-867b-f1f997c284ae tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:21:15.857395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-def5fffc-213f-4d10-b812-3e37b65f3d1a tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 200 len: 352 microversion: 2.1 time: 0.063493 Aug 02 10:21:15.857395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 11/20] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:15 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:15.861321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dd916d2c-7cf2-4c8b-906f-c7e2d6a9ca9d tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a2a670>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:15.911054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dd916d2c-7cf2-4c8b-906f-c7e2d6a9ca9d tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 288 microversion: 2.1 time: 0.055650 Aug 02 10:21:15.911871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 12/21] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:15 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:15.922941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c0c17a08-d915-4eac-abeb-7bbc02826804 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a1adc0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:16.013694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22d61614-5309-4762-867b-f1f997c284ae tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.440127 Aug 02 10:21:16.014305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 10/22] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:21:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:16.092252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c0c17a08-d915-4eac-abeb-7bbc02826804 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 202 len: 0 microversion: 2.1 time: 0.172960 Aug 02 10:21:16.095272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 13/23] 10.222.0.49 () {58 vars in 1254 bytes} [Tue Aug 2 10:21:15 2022] DELETE /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:21:16.107779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cbea135a-a3dd-484f-9b4e-888e926e3923 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c89bd280>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:16.148039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cbea135a-a3dd-484f-9b4e-888e926e3923 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 200 len: 287 microversion: 2.1 time: 0.050333 Aug 02 10:21:16.153862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:16 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:16.868965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3bc8f6f2-dd72-434b-a9f6-c74483d33e0c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Calling method '.version_select at 0x7f70c8a393a0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:16.978353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9a18e8a-de90-405d-8b3f-f3e9805048b0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89bd940>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:17.896219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-3bc8f6f2-dd72-434b-a9f6-c74483d33e0c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] HTTP exception thrown: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3bc8f6f2-dd72-434b-a9f6-c74483d33e0c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Request method failure captured: Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c HTTP/1.1 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqRkWvH3ocDtvS7IcURi6pKWf_Bn3FA2sVGcG8bnqqEfbnAccUdMWv7qPxpG0F-NomOXBrjDahvrzUkHk3shEJ-7uLCuRolWF1eb-SkTZtOGo_JWFQ7M6cJ3Y-qOgdq2o2opgZvuXXury-jMJn3AvhvVe5MQ-ALAkaDalTD2uU8cSY Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 8da396d25bf44b8d89ab2f28f0953db4 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesGetTestJSON-749578814 Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:21:17.900636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8da396d25bf44b8d89ab2f28f0953db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8da396d25bf44b8d89ab2f28f0953db4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8da396d25bf44b8d89ab2f28f0953db4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8da396d25bf44b8d89ab2f28f0953db4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesGetTestJSON-749578814 Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 8da396d25bf44b8d89ab2f28f0953db4 Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesGetTestJSON-749578814 Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesGetTestJSON-749578814-project Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 998e04c59ad64d3e98517ee84c4268a1 Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesGetTestJSON-749578814-project Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'd2a1b634-889b-42d4-b9ac-eb7fe54eb27c'} Aug 02 10:21:17.902068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. (HTTP 404) (Request-ID: req-a7a740d2-7e03-49b8-8134-d695a2412dd2) Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:17.902864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:17.903876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:21:17.904757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3bc8f6f2-dd72-434b-a9f6-c74483d33e0c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] Returning 404 to user: Volume d2a1b634-889b-42d4-b9ac-eb7fe54eb27c could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3bc8f6f2-dd72-434b-a9f6-c74483d33e0c tempest-VolumesGetTestJSON-749578814 tempest-VolumesGetTestJSON-749578814-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c" status: 404 len: 109 microversion: 2.1 time: 1.038916 Aug 02 10:21:17.906641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:16 2022] GET /compute/v2.1/os-volumes/d2a1b634-889b-42d4-b9ac-eb7fe54eb27c => generated 109 bytes in 1041 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:21:17.911287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7024d948-d1f1-4aa6-8403-282a92ac0e60 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a391f0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:17.975688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9a18e8a-de90-405d-8b3f-f3e9805048b0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/824a4cf8-a117-4f4d-82e6-720c8ff48ad1" status: 200 len: 351 microversion: 2.1 time: 1.000525 Aug 02 10:21:17.975688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:16 2022] GET /compute/v2.1/os-volumes/824a4cf8-a117-4f4d-82e6-720c8ff48ad1 => generated 351 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:17.987777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-139e0fb3-5b33-4614-a6af-838cb72c32dc tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89bdf70>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.041082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-7024d948-d1f1-4aa6-8403-282a92ac0e60 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] HTTP exception thrown: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7024d948-d1f1-4aa6-8403-282a92ac0e60 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Request method failure captured: Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd HTTP/1.1 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqR1KOnMRejdcFhbDxsmT-D54AeoYhD9ml6BwTH_x3Cg_aPdWxBt_YuplT4sc5Ni6GLcBoE0jyOskhIGW08tnLc2MYy--2cjH_If5tDMNJvtuv4-FzyvTUW2sicwjfFGnn9XaXpEf_VIIC3LGdTHr793ZF-OTX2RYjIG9JIAYUbtVw Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:21:18.043622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5db81d6f81114ce6a527b6e718453fc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 04456e2f28b14ff28857b7d22b4a468e Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '4ee992f8-5323-487d-b360-bdf59e30c1fd'} Aug 02 10:21:18.045213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. (HTTP 404) (Request-ID: req-5226a248-af00-4f73-a123-9e2e6320abb2) Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.045994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:18.047027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 10:21:18.049527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7024d948-d1f1-4aa6-8403-282a92ac0e60 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Returning 404 to user: Snapshot 4ee992f8-5323-487d-b360-bdf59e30c1fd could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7024d948-d1f1-4aa6-8403-282a92ac0e60 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd" status: 404 len: 111 microversion: 2.1 time: 0.140406 Aug 02 10:21:18.050454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1251 bytes} [Tue Aug 2 10:21:17 2022] GET /compute/v2.1/os-snapshots/4ee992f8-5323-487d-b360-bdf59e30c1fd => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:21:18.062120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-356275ae-470f-4d55-bd0a-aac786956dda tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a39160>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.214551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-139e0fb3-5b33-4614-a6af-838cb72c32dc tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.231060 Aug 02 10:21:18.215656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 13/28] 10.222.0.49 () {58 vars in 1134 bytes} [Tue Aug 2 10:21:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:18.230793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6877e5a5-7133-4ee1-b753-b1dc3c4e99b6 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89bd310>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.395081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-356275ae-470f-4d55-bd0a-aac786956dda tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 202 len: 0 microversion: 2.1 time: 0.342105 Aug 02 10:21:18.395687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:21:18 2022] DELETE /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:21:18.404411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f93f17f8-bd0f-4a21-b6b2-6fd65428c7d2 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a39f70>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.442731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6877e5a5-7133-4ee1-b753-b1dc3c4e99b6 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.216781 Aug 02 10:21:18.444126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 14/30] 10.222.0.49 () {58 vars in 1149 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:18.458332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18e40024-0833-4a80-aa8a-0f788e25b1e7 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c814f040>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.500956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f93f17f8-bd0f-4a21-b6b2-6fd65428c7d2 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.100022 Aug 02 10:21:18.501189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 17/31] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:18.615340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18e40024-0833-4a80-aa8a-0f788e25b1e7 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.161736 Aug 02 10:21:18.616495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 15/32] 10.222.0.49 () {58 vars in 1134 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:18.639591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-54ee5273-530d-4d80-8021-db1805cfa7a9 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89aa5e0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.823109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-54ee5273-530d-4d80-8021-db1805cfa7a9 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.197798 Aug 02 10:21:18.823866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 18/33] 10.222.0.49 () {58 vars in 1167 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:18.838893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca2cba2f-55bc-43e2-bf6d-df22f6b48ffe tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89ccca0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:19.107738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca2cba2f-55bc-43e2-bf6d-df22f6b48ffe tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.273250 Aug 02 10:21:19.117456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 16/34] 10.222.0.49 () {58 vars in 1170 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:19.125642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-01822b1e-4e79-444a-a669-145b753edcc0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89aaf70>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:19.318831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-01822b1e-4e79-444a-a669-145b753edcc0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.199379 Aug 02 10:21:19.319226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1155 bytes} [Tue Aug 2 10:21:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:19.333673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b1738016-6d62-4e11-9c81-c00d2b5901a8 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c89bd820>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:19.524256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b1738016-6d62-4e11-9c81-c00d2b5901a8 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195500 Aug 02 10:21:19.525572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1188 bytes} [Tue Aug 2 10:21:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:19.543682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb325671-eb63-413b-818d-0b0a229e7033 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c815a040>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:19.644455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb325671-eb63-413b-818d-0b0a229e7033 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.116670 Aug 02 10:21:19.645809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 18/37] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:19 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:19.655456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-23d76f6f-e364-4576-8c85-da104c23ddf0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] Calling method '.version_select at 0x7f70c814f430>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:19.764695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-687710298", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "networks": [{"uuid": "78aa5cc9-6ada-4744-b957-75034df05218"}]}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:19.872277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-23d76f6f-e364-4576-8c85-da104c23ddf0 tempest-VolumesTestJSON-1315525691 tempest-VolumesTestJSON-1315525691-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.224056 Aug 02 10:21:19.875594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1155 bytes} [Tue Aug 2 10:21:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:19.946092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] validate_networks() for [('78aa5cc9-6ada-4744-b957-75034df05218', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:21:20.034808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-19a14cbe-8c73-4e0b-9812-7f0d5bc929d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'create', calling method: .version_select at 0x7f70c89bd310>, body: {"keypair": {"name": "tempest-keypair-648805018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6v2HGt50WU8x0JiC//buydtwY031n0v1iWIIRweiMZlXPPMY8HkinVL1WrrF5u7NPTLOpLlheHZLJWByqjSaByakfGcMLC4JAiwTQuabyO91RyfVnG3XMjhgDcNta3+Q=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:20.085082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-19a14cbe-8c73-4e0b-9812-7f0d5bc929d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for project 662f508ce05e4a85896f30f772be6410. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:21:20.101660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-19a14cbe-8c73-4e0b-9812-7f0d5bc929d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for user f6880f2f7ad749beb68cd6445f3cc6d6 and project 662f508ce05e4a85896f30f772be6410. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:21:20.229872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-19a14cbe-8c73-4e0b-9812-7f0d5bc929d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.355257 Aug 02 10:21:20.230492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 20/39] 10.222.0.49 () {62 vars in 1200 bytes} [Tue Aug 2 10:21:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 357 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:21:20.659806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-996d65c9-69fd-4d44-b4f3-a7d544914286 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c89ccaf0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:20.756353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-996d65c9-69fd-4d44-b4f3-a7d544914286 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.101856 Aug 02 10:21:20.764338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 21/40] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:20 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:20.981532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571619393", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c49660-b8e9-4548-b1ea-a7c2e86c6f47"}], "security_groups": [{"name": "tempest-securitygroup--1580435427"}], "key_name": "tempest-keypair-390253294", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:21.296304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] validate_networks() for [('11c49660-b8e9-4548-b1ea-a7c2e86c6f47', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:21:21.781452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:21:21.781953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:21:21.782369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:21:21.782785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:21:21.783224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:21:21.801803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:21.802404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:21.803676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:21.804327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:21.858044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Getting quotas for project 74bbbe86d44348c0b1ed8ff50f493e28. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:21:21.869578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Getting quotas for user 306ea8d439d94da18d43d91ce9838e19 and project 74bbbe86d44348c0b1ed8ff50f493e28. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:21:21.898100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:21:21.905680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:21:22.106218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4ebc0431-63ab-4f77-900d-5af6043843df tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.703461 Aug 02 10:21:22.106218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:21:22.106218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a46f6fc9-8977-482e-9896-9e362e9276c1 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8098c10>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:22.167923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a46f6fc9-8977-482e-9896-9e362e9276c1 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.066785 Aug 02 10:21:22.169265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:22 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:22.177295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bff75c59-3938-4e79-aa30-97452b233094 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:22.178673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bff75c59-3938-4e79-aa30-97452b233094 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:22.311941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bff75c59-3938-4e79-aa30-97452b233094 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:22.327663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bff75c59-3938-4e79-aa30-97452b233094 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1214 microversion: 2.1 time: 0.155774 Aug 02 10:21:22.329408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:22 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:22.560600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:21:22.561069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:21:22.561513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:21:22.561923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:21:22.562333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:21:22.574789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:22.575255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:22.576410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:22.580385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:22.624949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:21:22.632907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:21:22.656304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:21:22.659940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:21:22.814762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-151083b0-9ded-476b-afc1-5f1cc4cb5407 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.839706 Aug 02 10:21:22.814762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:21:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:21:22.824763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d37a57c8-19fe-45fa-a8d0-f8948fa2fa72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:22.826497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d37a57c8-19fe-45fa-a8d0-f8948fa2fa72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:22.962107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d37a57c8-19fe-45fa-a8d0-f8948fa2fa72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:22.977204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d37a57c8-19fe-45fa-a8d0-f8948fa2fa72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1241 microversion: 2.1 time: 0.155241 Aug 02 10:21:22.977966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:23.182711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e0bc3ba-05b4-4390-bd84-c6b743679197 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c80fb430>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:23.340464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e0bc3ba-05b4-4390-bd84-c6b743679197 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.161992 Aug 02 10:21:23.341148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:23 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:23.353606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0d357f23-f905-4a84-bb7d-f09a5e768e79 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:23.356411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0d357f23-f905-4a84-bb7d-f09a5e768e79 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:23.539791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0d357f23-f905-4a84-bb7d-f09a5e768e79 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:23.547123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0d357f23-f905-4a84-bb7d-f09a5e768e79 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1214 microversion: 2.1 time: 0.200564 Aug 02 10:21:23.555518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:23 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:24.000511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-93652dea-4a64-4d88-a13c-8fad97a07d72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:24.001142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-93652dea-4a64-4d88-a13c-8fad97a07d72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:24.140788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-93652dea-4a64-4d88-a13c-8fad97a07d72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:24.160924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-93652dea-4a64-4d88-a13c-8fad97a07d72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1241 microversion: 2.1 time: 0.164519 Aug 02 10:21:24.175000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:24.356123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a14bff5f-6461-4ba7-9e0f-f29b033ad68b tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8058dc0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:24.428655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a14bff5f-6461-4ba7-9e0f-f29b033ad68b tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 200 len: 345 microversion: 2.1 time: 0.075594 Aug 02 10:21:24.430875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:24 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:24.570285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:24.571500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:24.579870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:24.586846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:24.588778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:24.589568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:24.654997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-641151357", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323ccc74-c2d0-4b0e-8e04-ec0be8a7f34a"}], "security_groups": [{"name": "tempest-securitygroup--536974768"}], "key_name": "tempest-keypair-648805018", "user_data": "}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:24.841088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:24.891353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c2f911c2-f733-4cce-b922-7682347fdc85 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1218 microversion: 2.1 time: 0.325678 Aug 02 10:21:24.901114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:24 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:24.968174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] validate_networks() for [('323ccc74-c2d0-4b0e-8e04-ec0be8a7f34a', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:21:25.199370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:25.201950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:25.223668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.224235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:25.228990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.228990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:25.411362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:25.448509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-696203c6-f4d8-425f-b279-8f28a7a7c106 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1245 microversion: 2.1 time: 0.266239 Aug 02 10:21:25.452118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1245 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:25.466250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a1703e89-bc94-4ce7-adaf-222e6eb2bc09 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c80209d0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:25.608184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-a1703e89-bc94-4ce7-adaf-222e6eb2bc09 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] HTTP exception thrown: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a1703e89-bc94-4ce7-adaf-222e6eb2bc09 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Request method failure captured: Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 HTTP/1.1 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqR1KOnMRejdcFhbDxsmT-D54AeoYhD9ml6BwTH_x3Cg_aPdWxBt_YuplT4sc5Ni6GLcBoE0jyOskhIGW08tnLc2MYy--2cjH_If5tDMNJvtuv4-FzyvTUW2sicwjfFGnn9XaXpEf_VIIC3LGdTHr793ZF-OTX2RYjIG9JIAYUbtVw Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:21:25.613350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5db81d6f81114ce6a527b6e718453fc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 04456e2f28b14ff28857b7d22b4a468e Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'f2ad75ef-ae2c-4446-afa7-069480cfe151'} Aug 02 10:21:25.616899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. (HTTP 404) (Request-ID: req-bf8609b8-ec48-49b0-a070-2212cf28d102) Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.617625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:25.618568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:21:25.620319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a1703e89-bc94-4ce7-adaf-222e6eb2bc09 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Returning 404 to user: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a1703e89-bc94-4ce7-adaf-222e6eb2bc09 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 404 len: 109 microversion: 2.1 time: 0.161532 Aug 02 10:21:25.621471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 27/52] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:25 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:21:25.635569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-147a67f4-b74a-4aee-b98e-4fa828386dbe tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8a1aaf0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:25.714121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-147a67f4-b74a-4aee-b98e-4fa828386dbe tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] HTTP exception thrown: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-147a67f4-b74a-4aee-b98e-4fa828386dbe tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Request method failure captured: Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 HTTP/1.1 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqR1KOnMRejdcFhbDxsmT-D54AeoYhD9ml6BwTH_x3Cg_aPdWxBt_YuplT4sc5Ni6GLcBoE0jyOskhIGW08tnLc2MYy--2cjH_If5tDMNJvtuv4-FzyvTUW2sicwjfFGnn9XaXpEf_VIIC3LGdTHr793ZF-OTX2RYjIG9JIAYUbtVw Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:21:25.716122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5db81d6f81114ce6a527b6e718453fc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 04456e2f28b14ff28857b7d22b4a468e Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'f2ad75ef-ae2c-4446-afa7-069480cfe151'} Aug 02 10:21:25.717254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. (HTTP 404) (Request-ID: req-73e0b27a-1b4b-45e5-a9cc-857d1f0d8762) Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.717951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:21:25.718881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:21:25.719840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-147a67f4-b74a-4aee-b98e-4fa828386dbe tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Returning 404 to user: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-147a67f4-b74a-4aee-b98e-4fa828386dbe tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 404 len: 109 microversion: 2.1 time: 0.087043 Aug 02 10:21:25.720726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 28/53] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:21:25 2022] DELETE /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:21:25.726132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1aceb22-c572-4a2f-9c32-65e0c04f2c46 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Calling method '.version_select at 0x7f70c8020820>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:25.748873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:21:25.750077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:21:25.750820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:21:25.751603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:21:25.753625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:21:25.767792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.769526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:25.770777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.771712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:25.805910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for project 662f508ce05e4a85896f30f772be6410. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:21:25.812519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for user f6880f2f7ad749beb68cd6445f3cc6d6 and project 662f508ce05e4a85896f30f772be6410. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:21:25.826593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:21:25.829909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:21:25.933321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-d1aceb22-c572-4a2f-9c32-65e0c04f2c46 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] HTTP exception thrown: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1aceb22-c572-4a2f-9c32-65e0c04f2c46 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Request method failure captured: Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 HTTP/1.1 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqR1KOnMRejdcFhbDxsmT-D54AeoYhD9ml6BwTH_x3Cg_aPdWxBt_YuplT4sc5Ni6GLcBoE0jyOskhIGW08tnLc2MYy--2cjH_If5tDMNJvtuv4-FzyvTUW2sicwjfFGnn9XaXpEf_VIIC3LGdTHr793ZF-OTX2RYjIG9JIAYUbtVw Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:21:25.938919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5db81d6f81114ce6a527b6e718453fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5db81d6f81114ce6a527b6e718453fc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 5db81d6f81114ce6a527b6e718453fc5 Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443131980 Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 04456e2f28b14ff28857b7d22b4a468e Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443131980-project Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'f2ad75ef-ae2c-4446-afa7-069480cfe151'} Aug 02 10:21:25.942105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. (HTTP 404) (Request-ID: req-90554afa-46bb-4278-83c2-3855b03d04f6) Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.942765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:21:25.944309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:21:25.945676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1aceb22-c572-4a2f-9c32-65e0c04f2c46 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] Returning 404 to user: Volume f2ad75ef-ae2c-4446-afa7-069480cfe151 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d1aceb22-c572-4a2f-9c32-65e0c04f2c46 tempest-VolumesSnapshotsTestJSON-443131980 tempest-VolumesSnapshotsTestJSON-443131980-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151" status: 404 len: 109 microversion: 2.1 time: 0.214556 Aug 02 10:21:25.948611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 29/54] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 10:21:25 2022] GET /compute/v2.1/os-volumes/f2ad75ef-ae2c-4446-afa7-069480cfe151 => generated 109 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:21:25.970017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:25.973097 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:25.995143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.995634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:25.996428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:25.996867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:26.094158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dccffaca-8726-4e35-9448-e3bd946f5248 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.464811 Aug 02 10:21:26.097312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 26/55] 10.222.0.49 () {62 vars in 1188 bytes} [Tue Aug 2 10:21:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 10:21:26.111457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:26.112597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:26.209975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:26.229535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:26.235392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e4e3db12-f407-4a03-a5f3-21517392f70c tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1266 microversion: 2.1 time: 0.285901 Aug 02 10:21:26.235992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 30/56] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:25 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:26.257025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:26.258555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:26.259753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d143c26b-b931-4ae2-af12-b7113ad7b6d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1280 microversion: 2.20 time: 0.154132 Aug 02 10:21:26.261316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:26.479681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:26.480696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:26.510078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:26.521257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:26.522288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:26.528013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:26.631168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:26.646552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-92d2aa21-dd7b-45e9-933f-8f767af9a455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1293 microversion: 2.1 time: 0.174383 Aug 02 10:21:26.647612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 31/58] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:27.264409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:27.265621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:27.291212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:27.293153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:27.293643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:27.294360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:27.299580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:27.300191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:27.552774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:27.571922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:27.574409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:27.576154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-14a9102f-990a-4405-a689-8f6437ddea5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1280 microversion: 2.20 time: 0.289562 Aug 02 10:21:27.591068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 32/59] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:27.672621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:27.673767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:27.685497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:27.685948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:27.692401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:27.693062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:27.907335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:27.922802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:27.941436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7fcdbe96-1fb8-4c2a-8093-aabfbe66a5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1311 microversion: 2.1 time: 0.270131 Aug 02 10:21:27.941436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 33/60] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:27.944590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7749f8e3-9397-4380-ba8a-9cbe49c81e89 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1272 microversion: 2.1 time: 0.687961 Aug 02 10:21:27.945176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 28/61] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:27 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1272 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:28.602698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:28.604639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:28.611488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.612130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:28.612943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.613383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:28.709401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:28.728623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:28.744775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:28.746031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2d202115-ed55-4636-8e39-a16475b3f08f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1276 microversion: 2.20 time: 0.147305 Aug 02 10:21:28.751882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 34/62] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:28.967967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:28.969021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:28.972585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:28.974468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:28.982170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.983281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.983928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:28.984503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:28.985379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.986001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:28.986554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:28.987522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:29.131415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:29.141581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9d299a7c-2878-4218-9a76-e99e87b14a9a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1272 microversion: 2.1 time: 0.178045 Aug 02 10:21:29.152924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:29.164471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 35/63] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:28 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:29.167713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-075dfd59-9872-4d18-8f78-8979a3571fee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1299 microversion: 2.1 time: 0.205243 Aug 02 10:21:29.171792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 29/64] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:29.780710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:29.780710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:29.789621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:29.790356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:29.791763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:29.792379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:29.941751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:29.967267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:29.973949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:29.977307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bf4f8a1c-e6b1-43ac-a6d0-c7817292a1c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1332 microversion: 2.20 time: 0.203898 Aug 02 10:21:29.979302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 36/65] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:30.166504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:30.168188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:30.183945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:30.190319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:30.191210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:30.201833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:30.209159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:30.209291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:30.210369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:30.213009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:30.213650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:30.222571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:30.976002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:30.976002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d57e3d6-b29b-43f0-a7e2-ec9c7d7ffbeb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.755355 Aug 02 10:21:30.976002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 37/66] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:31.005508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:31.006435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:31.016379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:31.018935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:31.023947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:31.029412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-255302b1-f102-4a08-8ef8-268895b06fca tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.867136 Aug 02 10:21:31.030085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:31.031274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 30/67] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:30 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:31.032670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:31.620480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:31.654073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:31.663571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:31.669404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-92807601-1dc7-4f9d-ab89-e995f156977b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1350 microversion: 2.20 time: 0.666574 Aug 02 10:21:31.672380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 38/68] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1350 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:21:32.004115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:32.005966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:32.020249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.020717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.021755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.022190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.056865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:32.061405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:32.068168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.071126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.074192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.075357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.576731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:32.587805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-300f017c-4e3d-45f6-9e1e-aa9b6df54279 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.595067 Aug 02 10:21:32.588433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 31/69] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:32.601389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:32.700627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:32.701311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:32.714657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.715109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.716130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:32.716747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:32.807248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:32.820889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:32.837763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:32.839795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:32.842208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-62b738a7-5ce9-4131-9c20-74bdf4dfdfe3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1338 microversion: 2.20 time: 0.145299 Aug 02 10:21:32.843393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 32/70] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1338 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:21:32.867134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-67ad26e7-7034-4304-bfee-578665a12a82 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.813549 Aug 02 10:21:32.872451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:32 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:33.626872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:33.628736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:33.702448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:33.702448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:33.702448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:33.702448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:33.868194 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:33.868815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:33.882883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:33.887139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:33.888334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:33.891222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:34.351251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:34.364049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e2fef451-8fd9-4207-8977-131c19e1ed68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.755821 Aug 02 10:21:34.364641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 33/72] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:34.384193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:34.387246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:34.433583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:34.434123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:34.434848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:34.435330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:34.553691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:34.571222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:34.574513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:34.583507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03ab4e35-e73e-4192-afee-f1922d17a280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.719687 Aug 02 10:21:34.584886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 40/73] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:35.057731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:35.067324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1a125e0-c030-4e24-9978-1c5331a31a28 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.701441 Aug 02 10:21:35.071139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 34/74] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:34 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:35.389219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:35.390989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:35.402373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.403246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.404820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.406300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.645007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-3c9c5c3c-6aad-4e49-8b23-46ed7d7ec4f9 req-55bc544b-0bca-41d3-9ae2-ba6e742c499c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8", "tag": "0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:35.683418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:35.692715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-70504226-3ae5-46ac-bac2-4383bbbc03a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.311614 Aug 02 10:21:35.693895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 35/75] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:35.698888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c9c5c3c-6aad-4e49-8b23-46ed7d7ec4f9 req-55bc544b-0bca-41d3-9ae2-ba6e742c499c service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.699386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c9c5c3c-6aad-4e49-8b23-46ed7d7ec4f9 req-55bc544b-0bca-41d3-9ae2-ba6e742c499c service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.699706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:35.700478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:35.716445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.717421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.722635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.723585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.768909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-3c9c5c3c-6aad-4e49-8b23-46ed7d7ec4f9 req-55bc544b-0bca-41d3-9ae2-ba6e742c499c service nova] Creating event network-changed:0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9 for instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 on hv-cinder-84753 Aug 02 10:21:35.772191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c9c5c3c-6aad-4e49-8b23-46ed7d7ec4f9 req-55bc544b-0bca-41d3-9ae2-ba6e742c499c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:21:35.774893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.775789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.777191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:35.777949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:35.791550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:35.804200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.compute.rpcapi [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:21:35.805323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] Releasing lock "compute-rpcapi-router" {{(pid=118453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:21:35.849999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-170733be-9d38-441f-aea8-08a578d0c440 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.048222 Aug 02 10:21:35.850889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 41/76] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:36.071358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:36.108623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:36.109604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:36.111280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a32bf04-1318-4c00-88ca-a071961d6d2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.416259 Aug 02 10:21:36.113273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 36/77] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:36.129274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:36.130513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:36.146276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:36.147006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:36.147904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:36.149722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:36.262869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=20 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:36.683756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:36.692542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-60853ca2-968d-43be-a560-e992b4376b25 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.577937 Aug 02 10:21:36.710657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 37/78] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:36 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:36.718070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:36.718692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:36.719800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-40ed7fe2-1380-4617-afc9-bc26511a8d35 req-a0c21123-f9eb-446a-8502-3091395ed10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2", "tag": "a07dc161-ee2f-4ada-8946-f48df2e49887"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:36.737665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:36.739295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:36.741110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:36.744994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:36.755055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:36.762896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-40ed7fe2-1380-4617-afc9-bc26511a8d35 req-a0c21123-f9eb-446a-8502-3091395ed10f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:36.764884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-40ed7fe2-1380-4617-afc9-bc26511a8d35 req-a0c21123-f9eb-446a-8502-3091395ed10f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:36.799738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-40ed7fe2-1380-4617-afc9-bc26511a8d35 req-a0c21123-f9eb-446a-8502-3091395ed10f service nova] Creating event network-changed:a07dc161-ee2f-4ada-8946-f48df2e49887 for instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 on hv-cinder-84753 Aug 02 10:21:36.814498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-40ed7fe2-1380-4617-afc9-bc26511a8d35 req-a0c21123-f9eb-446a-8502-3091395ed10f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.929627 Aug 02 10:21:36.818008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 42/79] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:37.149451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:37.151091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:37.183634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:37.184498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:37.185974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:37.187153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:37.467614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:37.480393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4ce97d8-bf07-4a35-b3d3-705ff762d265 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.767921 Aug 02 10:21:37.481601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 38/80] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:37.558480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=18 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:37.731592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:37.747953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:37.769518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:37.769967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:37.770741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:37.771176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:37.931015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:37.974535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:37.996598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:38.004547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e2756d3-feea-4426-94a0-15cb3874612f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.867117 Aug 02 10:21:38.010975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 43/81] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:38.525920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:38.526886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:38.548488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:38.549580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:38.550855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:38.551475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:38.574217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:38.592555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1ff460d1-5946-4e44-b195-cb27f9a2c423 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.880257 Aug 02 10:21:38.594804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 39/82] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:37 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:38.757018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:38.765733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8331e692-587c-4304-8d8f-94f745ecb056 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.247585 Aug 02 10:21:38.771050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 44/83] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:38.845961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-5b649a86-2a72-40c9-bdeb-872607347d81 req-cc6cfd44-070e-481a-9012-3fffe9f5fd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:38.865449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-5b649a86-2a72-40c9-bdeb-872607347d81 req-cc6cfd44-070e-481a-9012-3fffe9f5fd52 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:38.866030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-5b649a86-2a72-40c9-bdeb-872607347d81 req-cc6cfd44-070e-481a-9012-3fffe9f5fd52 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:38.902541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-5b649a86-2a72-40c9-bdeb-872607347d81 req-cc6cfd44-070e-481a-9012-3fffe9f5fd52 service nova] Creating event network-changed:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:21:38.903469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-5b649a86-2a72-40c9-bdeb-872607347d81 req-cc6cfd44-070e-481a-9012-3fffe9f5fd52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:21:38.905182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:38.906038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:38.906891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:38.907600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:38.921126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.rpcapi [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:21:38.922740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] Releasing lock "compute-rpcapi-router" {{(pid=118452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:21:38.949481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1346fd49-0459-4c2b-a95e-b031a3a1978d None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108584 Aug 02 10:21:38.969059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 40/84] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:39.036357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:39.037328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:39.053363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.053822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.057357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.058090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.389569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:39.400486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:39.402760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:39.404285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-609f7a80-882f-4aa9-b0b8-7f1c20efcc2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.372877 Aug 02 10:21:39.420425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 45/85] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:39.618157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:39.619046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:39.638242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.642256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.643154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.643992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.796023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:39.796670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:39.807181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.807780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.808708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:39.809151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:39.826846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:40.021902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:40.032168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f15dc79a-4006-4181-923c-e37229943e6b tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.420009 Aug 02 10:21:40.032780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 41/86] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:39 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:40.428405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:40.437694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:40.440942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:40.444510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:40.445682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:40.447971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:40.584281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:40.591600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:40.594351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4af4cacb-a7bb-4dc9-8548-2c4bc8be637e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.801669 Aug 02 10:21:40.603929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:40.606242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:40.607645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 46/87] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:40.607906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cc561ab1-34e3-45ca-9c23-7354ac9b75e0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.183892 Aug 02 10:21:40.608490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 42/88] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:41.054407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:41.073315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:41.073315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.073315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.073315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.073730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.217566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:41.235936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d50c415-8291-44e8-a3a9-cb27e1872da9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.184822 Aug 02 10:21:41.236663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 47/89] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:41 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:41.625415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:41.625415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:41.631664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:41.632682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:41.634582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.637250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.637250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.637250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.651975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.652491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.653490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.654047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.843798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:41.853222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cd8b70a0-c910-468d-b14d-69cb766a2679 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.233474 Aug 02 10:21:41.854641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 43/90] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:41.877105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:41.886068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:41.887676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:41.888815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa984712-44b6-4c09-9fe5-82a687a29bb9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.262176 Aug 02 10:21:41.891923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 48/91] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:42.258425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:42.259182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:42.266438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.267080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:42.268631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.269107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:42.273581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:42.435315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:42.447007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81226985-65be-4ab9-9192-2be0d3dca763 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.192563 Aug 02 10:21:42.453877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 44/92] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:42 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:42.877143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:42.879181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:42.886233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.886751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:42.887551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.887987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:42.912659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:42.913927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:42.928405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.930513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:42.932101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:42.932727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.094796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.103085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1f234144-6a54-496d-94c9-cf1b338abe41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.229863 Aug 02 10:21:43.113679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.115713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 49/93] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:43.125189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.131750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.134049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a06f0263-f200-40e5-a382-1154f6014401 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.225771 Aug 02 10:21:43.142649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 45/94] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:43.475121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:43.475768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:43.482314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:43.482761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.483574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:43.484148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.671772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.681522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c5b88db5-9d54-4ca9-b89a-a7eb75087790 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.211055 Aug 02 10:21:43.682105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 50/95] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:43 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:44.125632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:44.126296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:44.133894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.134339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.145890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.145890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.158559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:44.159165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:44.181036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.181036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.181036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.181036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.290969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.302139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a6d50aa3-038a-4a47-b7d2-dceac3331924 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.180609 Aug 02 10:21:44.304392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 46/96] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:44.409559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.418624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.420662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.422167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2fd87e41-e750-40ca-a03e-d36f068a803d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.267614 Aug 02 10:21:44.423943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 51/97] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:44.705579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:44.706205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:44.712367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.712811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.713688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.714125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.851012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.858450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-36fe460d-8f3e-4340-9609-544608c70627 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.156865 Aug 02 10:21:44.859330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 47/98] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:44 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:45.329810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:45.331668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:45.337860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.338587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.339382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.339966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.446621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:45.447367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:45.453573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.454094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.455911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.455911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.477074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:45.484666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ecee7410-a4b1-4fae-9b98-1fa96bec12c7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.160126 Aug 02 10:21:45.485646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:45.649743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:45.660998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:45.664331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:45.664331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fb25a85f-9ac2-4111-b8b4-173ca8ced2c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.221143 Aug 02 10:21:45.665254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 48/100] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:21:45.881255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:45.881875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:45.883874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:45.889066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.889520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.890291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.890725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.225760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:46.235491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0acf3370-c105-4571-a86f-93a00cb88f54 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.358507 Aug 02 10:21:46.237272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:45 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:46.508415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:46.510364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:46.513418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:46.520869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.521324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.522117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.522550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.686742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:46.688071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:46.696178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.696989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.698178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.698991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.789749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:46.798094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d30cb473-6a8c-40d3-bd15-3192d78c6c72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.295733 Aug 02 10:21:46.812335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 49/102] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:47.036941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:47.045782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:47.047073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:47.048243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc1b7c49-e2fc-414e-a033-f44b487d159a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.366097 Aug 02 10:21:47.053908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 54/103] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:21:47.265878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:47.267159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:47.278454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.279233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:47.280452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.281035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:47.455176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:47.468606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-34f2073c-383f-4a8c-b7d3-1bb6d4b22072 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.211295 Aug 02 10:21:47.469712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 50/104] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:47 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:47.836855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:47.838846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:47.843994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.844439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:47.845212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.845639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.023482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.035719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3fef6bab-f2b8-4f4b-a518-d555b98aadf8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.204078 Aug 02 10:21:48.042828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 55/105] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:48.074756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:48.075997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:48.088043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:48.088906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.090235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:48.091112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.349618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.372416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.375679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.378207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3d59c03-b413-4a9e-964f-4d113ea694e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.310264 Aug 02 10:21:48.392606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 51/106] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:48.500737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:48.509166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:48.509848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:48.510466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.511445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:48.512119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.687945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.700640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6a676bd-b339-437a-ab5d-ba77149ff529 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.206200 Aug 02 10:21:48.701561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 56/107] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:48 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:49.066866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:49.067531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:49.071059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:49.075152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.076235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.076416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.076809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.294705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.304762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-da54c700-1e26-4e7e-9054-290ab9adb80d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.243233 Aug 02 10:21:49.305817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 52/108] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:49.418315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:49.418934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:49.426632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.427079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.432991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.432991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.645147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.653617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.655300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.656364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d2e781f2-8ba4-4dd8-bff1-04d3e452d086 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.242396 Aug 02 10:21:49.656912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 57/109] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:21:49.724910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:49.726193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:49.737447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.738417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.739848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.741050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.909053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.917127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8fbc8253-c230-4a08-97bd-b3d42f40e9ab tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.197982 Aug 02 10:21:49.917906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 53/110] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:49 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:50.342069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:50.342776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:50.350477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.351084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.352005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.352599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.557407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:50.566327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a38dcfb5-6c42-470c-9800-f715832f7769 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.228169 Aug 02 10:21:50.566905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 58/111] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:50.678447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:50.679135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:50.685783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.686235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.687019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.687495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.833369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:50.851536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:50.853623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:50.854968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de05f562-71a5-421f-b620-b13c0a52abda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.180551 Aug 02 10:21:50.855692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 54/112] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:50.952616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:50.953408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:50.961808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.962561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.963558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.964052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.151969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:51.160004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d30f2c9-6418-468f-a0d6-6c8a20345ec6 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.213854 Aug 02 10:21:51.161200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 59/113] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:50 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:51.587576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:51.588191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:51.594602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.595052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.596392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.596907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.782655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:51.789579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d3bb7eb-a4a6-4062-9f9f-69fc5539973e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.206035 Aug 02 10:21:51.790680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 55/114] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:51.880718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:51.882504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:51.891815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.892613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.894626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.895174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.053756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.068090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.070581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.073084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a960636d-c982-419c-9647-5ec6d03ca913 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.198607 Aug 02 10:21:52.074312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 60/115] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:52.182836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:52.183481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:52.190285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.190728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.191557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.191992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.376680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.387068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-540a7557-25fe-4bb5-bdc4-25991e060003 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.209069 Aug 02 10:21:52.388301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 56/116] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:52 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:52.811507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:52.812117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:52.818717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.819166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.819958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.820391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.974088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.983054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd39e4fa-ee5d-41d5-96d1-7ab8915d3637 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.175518 Aug 02 10:21:52.984387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 61/117] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:53.096983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:53.097584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:53.106292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:53.107261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:53.108613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:53.109275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:53.261605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:53.266090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:53.268134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:53.269255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-86cf964b-c63d-4da8-b59f-2a42c86324fb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.176723 Aug 02 10:21:53.269807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 57/118] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:53.410941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:53.411674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:53.421648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:53.421648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:53.421648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:53.421648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:53.561392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:53.565111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:53.569681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fd59a79e-dfc1-4732-8b1b-3d80f3c0c636 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.163292 Aug 02 10:21:53.570398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 62/119] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:53 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:54.007516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.007678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.013822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.014275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.015050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.015524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.160604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.168400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7fe3d608-73cb-428f-9e96-53d5d783f377 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.166533 Aug 02 10:21:54.169028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 58/120] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:54.294105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.294790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.301662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.302101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.302852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.303302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.449539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.456814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.458323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.459465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-40983e08-c458-4dfe-b749-32a92e112bb7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.169745 Aug 02 10:21:54.460023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 63/121] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:54.590484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.591375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.598389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.599059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.599864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.600297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.742422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.756543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6e14b727-4d53-458f-ac09-6295471ac260 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.169913 Aug 02 10:21:54.757119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 59/122] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:54 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:55.190535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:55.191398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:55.197637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.198114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.198877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.199340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.348214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.356159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03becf81-5be5-4f7e-8c37-2537624ec78c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.170093 Aug 02 10:21:55.356744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 64/123] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:55.482111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:55.482775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:55.489398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.489851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.490652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.491089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.628227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.631744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:55.636820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.638365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.639533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-14300aa1-e1af-4749-9329-19da427a9ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.161425 Aug 02 10:21:55.640141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 60/124] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:55.777302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:55.777991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:55.784421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.784872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.785712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.786196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.923572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.931520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c8a76ea-1c3c-4b2e-99a8-ee81d5fc22aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.158670 Aug 02 10:21:55.932105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 65/125] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:55 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:56.378174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:56.378692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:56.384941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.385388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.386156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.386624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.529212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.537437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-548b791c-ea0a-46dd-b1e4-e01a75889b8f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.163640 Aug 02 10:21:56.538011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 61/126] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:56.662523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:56.663123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:56.669137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.669578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.670329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.670754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.812371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.821594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.823207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.824486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4553a62a-e5e8-4615-85c2-43a000b85f82 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.166421 Aug 02 10:21:56.825124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 66/127] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:56.952949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:56.953572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:56.960363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.960817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.961596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.962033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.128792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:57.136497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b71399d2-f32e-4b53-906d-6296b3d6c2b7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.187391 Aug 02 10:21:57.137652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 62/128] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:56 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:57.558319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:57.559058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:57.565380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.565827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.566595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.567027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.716727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:57.725018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-30f9b984-6ee7-4cda-a4ed-50a532a16852 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.170660 Aug 02 10:21:57.725588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 67/129] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:57.848289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:57.849500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:57.856320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.856793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.857711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.858148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.006878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.015334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.016856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.018453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5c1f3768-2afc-4641-b24d-3b4015975484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.175101 Aug 02 10:21:58.019011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 63/130] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:58.156416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:58.157023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:58.163713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.164154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.164905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.165333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.302978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.310833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-588f1e67-f96d-4603-b9af-b2f885246afe tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.158250 Aug 02 10:21:58.311448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 68/131] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:58 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:58.747827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:58.748706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:58.754994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.755546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.756387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.756902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.913060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.922779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dd0fd0cc-9624-4fa4-9bbe-f5f576442e1a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.179463 Aug 02 10:21:58.923918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 64/132] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:59.041848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:59.042455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:59.048921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.049437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.050210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.050645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.227088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:59.238121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:59.239731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:59.240865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2c388864-8032-4020-b371-4a17a1401903 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.203048 Aug 02 10:21:59.241578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 69/133] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:59.333353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:59.333967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:59.340105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.340552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.341507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.345145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.481533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:59.490767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-891d0175-d5cf-4c72-97bf-f58c4bf46bbc tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.161998 Aug 02 10:21:59.491351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 65/134] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:59 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:59.945926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:59.946697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:59.952768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.953290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.954090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.954502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.095842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.103293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b52136e-3631-4cbc-a454-1df2823520da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.161156 Aug 02 10:22:00.104046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 70/135] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:00.264823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:00.265434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:00.271528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:00.271975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.272740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:00.273180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.405217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.413338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.414847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.416015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aeeb6fe9-4626-4df1-ae14-7587eabfb120 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.155181 Aug 02 10:22:00.416560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 66/136] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:00.514690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:00.515363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:00.521469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:00.521920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.522699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:00.523133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.656799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.665127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b303f043-11c5-45e3-9cae-c96cbba7e9aa tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.154320 Aug 02 10:22:00.665685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 71/137] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:00 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:01.125408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:01.126030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:01.132107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.132559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.133326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.133770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.267476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.276630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e192d5c-7af0-449b-a2cf-94cfbbd944cf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.154927 Aug 02 10:22:01.291042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 67/138] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:01.441246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:01.441853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:01.447725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.448161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.448981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.449511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.585002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-09c296ad-41b0-4fd2-8356-20a42d50cda1 req-26df9890-8d91-43b5-b025-b9b3004c6241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8", "name": "network-vif-plugged", "status": "completed", "tag": "0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:01.597929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-09c296ad-41b0-4fd2-8356-20a42d50cda1 req-26df9890-8d91-43b5-b025-b9b3004c6241 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.597929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-09c296ad-41b0-4fd2-8356-20a42d50cda1 req-26df9890-8d91-43b5-b025-b9b3004c6241 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.598146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.606908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.607734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-09c296ad-41b0-4fd2-8356-20a42d50cda1 req-26df9890-8d91-43b5-b025-b9b3004c6241 service nova] Creating event network-vif-plugged:0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9 for instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 on hv-cinder-84753 Aug 02 10:22:01.608715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.610027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fd0111be-5a2e-4346-9b2e-7f2631e46ad8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.173594 Aug 02 10:22:01.613127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 72/139] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:01.613752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-09c296ad-41b0-4fd2-8356-20a42d50cda1 req-26df9890-8d91-43b5-b025-b9b3004c6241 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095891 Aug 02 10:22:01.614320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 68/140] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:22:01.687435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:01.688065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:01.696651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.697380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.698190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.698656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.839339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.848776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-866ccde4-d3a7-4544-bb46-ec691701b6c4 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.165539 Aug 02 10:22:01.854729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 73/141] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:01 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:02.298512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:02.299929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:02.306876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.307259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.308037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.308466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.485074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:02.493170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-27a9b363-66c2-4e5c-a332-5db96f4da7d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.198986 Aug 02 10:22:02.493743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 69/142] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:02.637783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:02.638434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:02.645039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.645507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.646257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.646684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.870564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:02.871220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:02.878352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.878782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.879664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.880107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.985438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:02.995779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:02.997902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:02.999987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f57f7dd2-2f86-4f58-9de1-bd07b6b57603 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.365678 Aug 02 10:22:03.009495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 74/143] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:03.047526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:03.054270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-508199a2-5696-4095-b9f5-00c5ab0ec70d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.187659 Aug 02 10:22:03.055033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 70/144] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:02 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:03.514778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:03.515640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:03.522139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:03.522606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:03.523406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:03.523985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:03.665765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:03.674617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-533aaa04-49ee-4ae0-b84b-2613091ee609 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1367 microversion: 2.1 time: 0.163449 Aug 02 10:22:03.675172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 75/145] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:03.760856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "name": "network-vif-plugged", "status": "completed", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}, {"server_uuid": "9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2", "name": "network-vif-plugged", "status": "completed", "tag": "a07dc161-ee2f-4ada-8946-f48df2e49887"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:03.773035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:03.773558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:03.792019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] Creating event network-vif-plugged:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:22:03.793206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] Creating event network-vif-plugged:a07dc161-ee2f-4ada-8946-f48df2e49887 for instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 on hv-cinder-84753 Aug 02 10:22:03.801454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-18d69e7d-47f5-47af-a2ec-bd1cf256c501 req-b825d4b6-4419-424f-a0e8-78df169114a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044419 Aug 02 10:22:03.802387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 71/146] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:04.037753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:04.038659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:04.045475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.046190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.047028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.047537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.076956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:04.077663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:04.092051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.092518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.093452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.093929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.286362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.311116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.315351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.320910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47269dab-034c-4c63-9784-c38c84cd2be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.287315 Aug 02 10:22:04.322581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 76/147] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:04.356689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.365616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0508deb8-0c77-4c84-83e9-393a2eaeb758 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.293198 Aug 02 10:22:04.366360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 72/148] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:04 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:04.704544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:04.705236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:04.712330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.712849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.713837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.714412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.864771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.880979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6e6b14f9-b603-4a8c-998d-7166bee20968 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1557 microversion: 2.1 time: 0.180252 Aug 02 10:22:04.881573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 77/149] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:04.902834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:04.903382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:04.910834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.911323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.912165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.912608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.051776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69c5ef4f-3361-4b7a-9f95-f2b6becfc37f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153126 Aug 02 10:22:05.052423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 73/150] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:22:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:05.352341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:05.353574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:05.361134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.361284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.362334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.363127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.389743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:05.391042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:05.400615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.402765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.416146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.416146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.519675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:05.527656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:05.529169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:05.530274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-338b66d1-291c-4eb6-a6dc-42b5ddaaf14e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.186770 Aug 02 10:22:05.530813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 78/151] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:05.999905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:06.008000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e08931fa-6c31-4768-b63c-a7594afca9cb tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.624551 Aug 02 10:22:06.013052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 74/152] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:05 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:06.553665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:06.554779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:06.561487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:06.562157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:06.563064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:06.563905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:06.585981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:06.723252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:06.732698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:06.734792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:06.736566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-710d9136-aca5-4e05-966d-92bcd9d7a867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.187047 Aug 02 10:22:06.738324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 79/153] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:06.754579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-ba76a884-c8a4-4b1d-9315-6d5407ba4fd1 req-934ff378-17e6-4074-9abd-d2d10b3ca5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8", "tag": "0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:06.776838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ba76a884-c8a4-4b1d-9315-6d5407ba4fd1 req-934ff378-17e6-4074-9abd-d2d10b3ca5ab service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:06.777574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ba76a884-c8a4-4b1d-9315-6d5407ba4fd1 req-934ff378-17e6-4074-9abd-d2d10b3ca5ab service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:06.807291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-ba76a884-c8a4-4b1d-9315-6d5407ba4fd1 req-934ff378-17e6-4074-9abd-d2d10b3ca5ab service nova] Creating event network-changed:0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9 for instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 on hv-cinder-84753 Aug 02 10:22:06.813883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-ba76a884-c8a4-4b1d-9315-6d5407ba4fd1 req-934ff378-17e6-4074-9abd-d2d10b3ca5ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065225 Aug 02 10:22:06.815731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 75/154] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:22:07.036541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:07.037722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:07.045010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:07.045651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:07.051438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:07.051438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:07.226128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:07.238271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4fcba63e-fe48-4264-84ff-ba3c547faec7 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.206800 Aug 02 10:22:07.239130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 80/155] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:07 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:07.764939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:07.766500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:07.774033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:07.774570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:07.775970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:07.781329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:07.942466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:07.952291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:07.956261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:07.956261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d39c7e65-3fec-48af-ba78-00a02aa0a4ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.196069 Aug 02 10:22:07.957657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 76/156] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:08.261994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:08.262701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.271324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.271787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.273681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.273681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.547390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:08.557333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc55264a-b5d9-4c32-83f8-1793fac34587 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.299486 Aug 02 10:22:08.559724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 81/157] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:08 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:08.979083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:08.979735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.986153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.987182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.987968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.988407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:09.146306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:09.155098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:09.156731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:09.157943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2d4c172b-c455-4df9-9211-39c005112f4d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1405 microversion: 2.20 time: 0.182664 Aug 02 10:22:09.161110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 77/158] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:09.578629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:09.583054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:09.598416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=80 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:09.600007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:09.600454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:09.601239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:09.601674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:09.812887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:09.834325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d87ab4c2-fac3-45db-8292-d273310c2d69 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1314 microversion: 2.1 time: 0.259220 Aug 02 10:22:09.835453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 82/159] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:09 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:10.182927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:10.183653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:10.190165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.190680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.191487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.192117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.381203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:10.393207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:10.395783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:10.398818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b61a76a-525f-42f9-bff4-53257d95e87a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1597 microversion: 2.20 time: 0.219265 Aug 02 10:22:10.400575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 78/160] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:10.424460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:10.425315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:10.443071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.443576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.449186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.449646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.686792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8186f874-3259-4500-a62d-b7f18529133f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.267690 Aug 02 10:22:10.688853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 83/161] 10.222.0.49 () {60 vars in 1316 bytes} [Tue Aug 2 10:22:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-interface => generated 285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:22:10.858780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:10.859898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:10.872509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.874241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.875290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.876044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:11.040685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:11.045346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:11.050854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75f68196-1e0b-4256-892e-d3d9cea8d95d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1500 microversion: 2.1 time: 0.197216 Aug 02 10:22:11.051485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 79/162] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:10 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:12.333217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0a71db27-2e5b-4d64-b32f-ba337c18e391 req-ed0f7a6b-f9a0-49df-88ca-cc6f698a447b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:12.345314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a71db27-2e5b-4d64-b32f-ba337c18e391 req-ed0f7a6b-f9a0-49df-88ca-cc6f698a447b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:12.345794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a71db27-2e5b-4d64-b32f-ba337c18e391 req-ed0f7a6b-f9a0-49df-88ca-cc6f698a447b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:12.359135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0a71db27-2e5b-4d64-b32f-ba337c18e391 req-ed0f7a6b-f9a0-49df-88ca-cc6f698a447b service nova] Creating event network-changed:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:22:12.365976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0a71db27-2e5b-4d64-b32f-ba337c18e391 req-ed0f7a6b-f9a0-49df-88ca-cc6f698a447b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037078 Aug 02 10:22:12.366649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 84/163] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:14.167904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca2a16c-4372-4b1d-b366-da57e72231e4"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:14.170556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:14.178333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:14.179052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:14.180179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:14.180885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:15.445033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f27c44d4-bd32-4622-b9df-27d3c03b406a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "POST /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.281181 Aug 02 10:22:15.445702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 80/164] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:22:14 2022] POST /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2/os-volume_attachments => generated 194 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:22:28.937734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:28.942728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:28.942728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=5 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:28.942728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=26 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:28.946938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:28.947436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:28.948266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:28.948699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:28.974321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:22:29.418973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e058422-6308-4d5c-b75e-834826bdf650 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 204 len: 0 microversion: 2.1 time: 0.484939 Aug 02 10:22:29.419614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 85/165] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:22:28 2022] DELETE /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:22:29.438800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=63 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:29.439672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:29.444043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:29.444758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:29.451929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.452376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.453180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.453634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.650763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:29.660018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-24d54cba-6b1a-4ae8-a5ae-26c26a5268d9 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1552 microversion: 2.1 time: 0.223040 Aug 02 10:22:29.660922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 81/166] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:29 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:30.685051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:30.685051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:30.692465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.692990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.693900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.694524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.837738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:30.858256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b58120e5-9566-45af-840a-4539b1083753 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1552 microversion: 2.1 time: 0.179923 Aug 02 10:22:30.858848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 86/167] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:30 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:31.880468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:31.881086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:31.888272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.888721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.889590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.889973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.033704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:32.042568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-662a25ca-df4d-41e4-a6a9-9a72bf899ebd tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1552 microversion: 2.1 time: 0.166408 Aug 02 10:22:32.043123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 82/168] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:31 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:33.076565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:33.077392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:33.084006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.084459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.085236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.085682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.234117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.245986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-80c40442-e7c6-41a5-8a1f-fc668fb7133d tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1552 microversion: 2.1 time: 0.173287 Aug 02 10:22:33.247682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 87/169] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:33 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:34.081694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-ed4c2929-90c2-4f4f-a652-2bca4ffc33b9 req-b90f6ca8-5e6d-40e6-8a10-ff56731e9656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2", "name": "network-vif-deleted", "tag": "a07dc161-ee2f-4ada-8946-f48df2e49887"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:34.093409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ed4c2929-90c2-4f4f-a652-2bca4ffc33b9 req-b90f6ca8-5e6d-40e6-8a10-ff56731e9656 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.093992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ed4c2929-90c2-4f4f-a652-2bca4ffc33b9 req-b90f6ca8-5e6d-40e6-8a10-ff56731e9656 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.109636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-ed4c2929-90c2-4f4f-a652-2bca4ffc33b9 req-b90f6ca8-5e6d-40e6-8a10-ff56731e9656 service nova] Creating event network-vif-deleted:a07dc161-ee2f-4ada-8946-f48df2e49887 for instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 on hv-cinder-84753 Aug 02 10:22:34.116047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-ed4c2929-90c2-4f4f-a652-2bca4ffc33b9 req-b90f6ca8-5e6d-40e6-8a10-ff56731e9656 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038625 Aug 02 10:22:34.116658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 83/170] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:34.268468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:34.269026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:34.276151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.276605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.277459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.277909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.349669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:34.357767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a33fec61-f98a-4f23-aac6-6122727a921f tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1345 microversion: 2.1 time: 0.093896 Aug 02 10:22:34.358323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 88/171] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:34 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:35.382376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:35.383075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:35.389900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.390343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.391158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.391707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.426210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.426657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.427166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lazy-loading 'fault' on Instance uuid 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:22:35.473420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306ea8d439d94da18d43d91ce9838e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bbbe86d44348c0b1ed8ff50f493e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:35.481716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3daf4b02-34b8-42d3-9fed-75e978a09d75 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 200 len: 1350 microversion: 2.1 time: 0.103712 Aug 02 10:22:35.482455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 84/172] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:35 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:36.504252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:36.505536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:36.511811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.512327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.513115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.513558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.529356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] HTTP exception thrown: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Request method failure captured: Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 HTTP/1.1 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6Pqfx76qfaPBCPIOLDzXbpW6OAQpo4UzkoyLbUF9J3OUNDCmYUp2tKLDI5biRDcgQeutLNmMZOsqyt7LbKydxHZsda841wrpAtYapTLb-1CUbA79WITAnL-2he_JqO1NDibNsaxh3MSrpA_azojOdPlAG_MV0-5wrRvXtRufHqCgdeg Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:22:36.534122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bbbe86d44348c0b1ed8ff50f493e28", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 306ea8d439d94da18d43d91ce9838e19 Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.535773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2'} Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:36.536637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.538258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.539519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Returning 404 to user: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:36.539519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f2864609-635d-4d9f-81cc-cc7d055d683a tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 404 len: 111 microversion: 2.1 time: 0.035959 Aug 02 10:22:36.539644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 89/173] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:36 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:36.771817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:36.774417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:36.789218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.789678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.794573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.795039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.831810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] HTTP exception thrown: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Request method failure captured: Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2/os-volume_attachments HTTP/1.1 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6Pqfx76qfaPBCPIOLDzXbpW6OAQpo4UzkoyLbUF9J3OUNDCmYUp2tKLDI5biRDcgQeutLNmMZOsqyt7LbKydxHZsda841wrpAtYapTLb-1CUbA79WITAnL-2he_JqO1NDibNsaxh3MSrpA_azojOdPlAG_MV0-5wrRvXtRufHqCgdeg Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:22:36.849823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bbbe86d44348c0b1ed8ff50f493e28", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 306ea8d439d94da18d43d91ce9838e19 Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.851960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2'} Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:36.853181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:36.854684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:36.856788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Returning 404 to user: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:36.856788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-32662b3d-6527-4f49-908b-dfbe4cef4f74 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087022 Aug 02 10:22:36.856788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:22:36 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:38.286885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:38.287628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:38.300388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.302622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.304992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.306022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.371038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] HTTP exception thrown: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Request method failure captured: Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 HTTP/1.1 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6Pqfx76qfaPBCPIOLDzXbpW6OAQpo4UzkoyLbUF9J3OUNDCmYUp2tKLDI5biRDcgQeutLNmMZOsqyt7LbKydxHZsda841wrpAtYapTLb-1CUbA79WITAnL-2he_JqO1NDibNsaxh3MSrpA_azojOdPlAG_MV0-5wrRvXtRufHqCgdeg Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:22:38.372759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bbbe86d44348c0b1ed8ff50f493e28", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 306ea8d439d94da18d43d91ce9838e19 Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.374198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2'} Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:38.375039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.376511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.378499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Returning 404 to user: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:38.379142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5cabbc4b-68ae-4fe5-8028-83f9ce5021a3 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 404 len: 111 microversion: 2.1 time: 0.097981 Aug 02 10:22:38.380024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 90/175] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:22:38 2022] DELETE /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:38.388520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:38.389306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] [instance: 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:38.396984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.398155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.398748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.399408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.417687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] HTTP exception thrown: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Request method failure captured: Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 HTTP/1.1 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6Pqfx76qfaPBCPIOLDzXbpW6OAQpo4UzkoyLbUF9J3OUNDCmYUp2tKLDI5biRDcgQeutLNmMZOsqyt7LbKydxHZsda841wrpAtYapTLb-1CUbA79WITAnL-2he_JqO1NDibNsaxh3MSrpA_azojOdPlAG_MV0-5wrRvXtRufHqCgdeg Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:22:38.420006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bbbe86d44348c0b1ed8ff50f493e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bbbe86d44348c0b1ed8ff50f493e28", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 74bbbe86d44348c0b1ed8ff50f493e28 Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-DeleteServersTestJSON-616715019 Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 306ea8d439d94da18d43d91ce9838e19 Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-DeleteServersTestJSON-616715019-project Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.421498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2'} Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:38.422424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. Aug 02 10:22:38.423742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:22:38.424856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] Returning 404 to user: Instance 9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:38.424856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bdd38468-bb2f-404c-bde9-160cc34e5350 tempest-DeleteServersTestJSON-616715019 tempest-DeleteServersTestJSON-616715019-project] 10.222.0.49 "GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2" status: 404 len: 111 microversion: 2.1 time: 0.037743 Aug 02 10:22:38.424856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 86/176] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:38 2022] GET /compute/v2.1/servers/9bed3ab0-4b9c-43d7-9b18-a7b710cc51c2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:44.196228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-129291791", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "networks": [{"uuid": "53f05d13-0ece-49e6-8287-3ac24c15615d"}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:44.268627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] validate_networks() for [('53f05d13-0ece-49e6-8287-3ac24c15615d', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:22:44.734651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:22:44.736394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:22:44.736394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:22:44.736394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:22:44.736902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:22:44.745818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:44.746260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:44.747058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:44.747522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:44.765321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Getting quotas for project 356ad325d7914771a7e1b66caf2b6e4d. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:22:44.769923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Getting quotas for user 1a800d95ac1d492bb44947fdf5bb3377 and project 356ad325d7914771a7e1b66caf2b6e4d. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:22:44.781608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:22:44.784296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:22:44.956547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-01953963-7978-4178-9237-73f604c96b48 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758600 Aug 02 10:22:44.957365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 91/177] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:22:44.972567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b90dc55f-a0f7-4968-af2f-8ef6b9becd8e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:44.972567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b90dc55f-a0f7-4968-af2f-8ef6b9becd8e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:45.064961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b90dc55f-a0f7-4968-af2f-8ef6b9becd8e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:45.073770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b90dc55f-a0f7-4968-af2f-8ef6b9becd8e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1218 microversion: 2.1 time: 0.109002 Aug 02 10:22:45.074690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 87/178] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:44 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:46.096667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c00963c-6391-4bcf-9286-c688a7b957a7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:46.098022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7c00963c-6391-4bcf-9286-c688a7b957a7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:46.200181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7c00963c-6391-4bcf-9286-c688a7b957a7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:46.211577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7c00963c-6391-4bcf-9286-c688a7b957a7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1218 microversion: 2.1 time: 0.119567 Aug 02 10:22:46.225648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 92/179] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:46 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:47.232837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:47.233572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:47.243683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:47.243928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:47.245069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:47.245956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:47.335041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:47.347490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c2f5cf5-812c-486f-baa0-3f62ef1565fc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1270 microversion: 2.1 time: 0.118766 Aug 02 10:22:47.349177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 88/180] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:47 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:48.373188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:48.376049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:48.390284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:48.397611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:48.397611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:48.397611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:48.499161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:48.509368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c06e270-1681-4cfd-8878-30208fbf55b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1276 microversion: 2.1 time: 0.143177 Aug 02 10:22:48.510695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 93/181] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:48 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:49.537932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:49.539069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:49.549675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:49.551754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:49.552852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:49.552852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:49.830716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:49.840694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c8bec6dd-95c0-4f06-a3ff-352507f43f4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.309759 Aug 02 10:22:49.855214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 89/182] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:49 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:49.962184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-b5f8b2da-4d7c-42fb-9b8d-68d76089cc35 req-863672f4-cbdd-46f0-ab49-133d863e96a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da1d83c-cb8c-4809-a11b-6987fc2a7a6d", "tag": "eab2d499-08a8-479f-8c33-048e39479f51"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:49.984815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b5f8b2da-4d7c-42fb-9b8d-68d76089cc35 req-863672f4-cbdd-46f0-ab49-133d863e96a0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:49.988724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b5f8b2da-4d7c-42fb-9b8d-68d76089cc35 req-863672f4-cbdd-46f0-ab49-133d863e96a0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:50.020625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-b5f8b2da-4d7c-42fb-9b8d-68d76089cc35 req-863672f4-cbdd-46f0-ab49-133d863e96a0 service nova] Creating event network-changed:eab2d499-08a8-479f-8c33-048e39479f51 for instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d on hv-cinder-84753 Aug 02 10:22:50.023992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-b5f8b2da-4d7c-42fb-9b8d-68d76089cc35 req-863672f4-cbdd-46f0-ab49-133d863e96a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067027 Aug 02 10:22:50.025226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 94/183] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:50.869090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:50.869730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:50.889326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:50.889326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:50.889326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:50.889326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:51.321029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:51.330702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e82e1fd8-7602-482d-bcbc-a0c8b88ac2de tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.471872 Aug 02 10:22:51.332215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 90/184] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:50 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:52.355516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:52.357099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:52.364265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:52.364986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:52.365819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:52.366422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:52.515875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:52.524897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f20cdc24-9147-4c09-a416-001c3a2f26e9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.175139 Aug 02 10:22:52.525640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 95/185] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:52 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:53.551244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:53.551244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:53.565339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:53.565795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:53.566846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:53.567318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:53.722787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:53.724771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:53.731247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:53.731926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:53.732901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:53.733338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:53.759051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c5f8fc2c-4907-4d2b-b31c-13df6b735a24 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.040551 Aug 02 10:22:53.780141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 96/186] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:22:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:53.792845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:53.806184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-994d512e-f8b2-4004-8d43-608b2afb35a5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.262811 Aug 02 10:22:53.807299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 91/187] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:53 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:54.523245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1131029390", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:54.592145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] validate_networks() for [('6b48ca37-69cf-48d5-96ff-4dba63259b29', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:22:54.754755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:54.830583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:54.831358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:54.840137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:54.843874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:54.843874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:54.843874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.035916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:55.050516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fd34febe-d4ce-4ad3-a693-1c1a05acbfa1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.223768 Aug 02 10:22:55.053964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 92/188] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:54 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:55.090461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:22:55.090885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:22:55.091386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:22:55.091824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:22:55.092299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:22:55.102291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.102737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.103579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.104019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.121651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:22:55.125695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for user 9e50546af342492b9b6f6127b0ce2c61 and project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:22:55.137130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:22:55.139486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:22:55.341694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-819c44a2-2418-4f18-99c5-bf7307d2f368 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.946321 Aug 02 10:22:55.342330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 97/189] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:22:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:22:55.353431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c31fcb7-7947-4d75-8cc7-4f14bab7461f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:55.354343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c31fcb7-7947-4d75-8cc7-4f14bab7461f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:55.358228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:55.416310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3c31fcb7-7947-4d75-8cc7-4f14bab7461f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:55.423657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c31fcb7-7947-4d75-8cc7-4f14bab7461f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1222 microversion: 2.1 time: 0.074086 Aug 02 10:22:55.424232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 93/190] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:55 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:55.489059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-320743083", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:55.553320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] validate_networks() for [('6b48ca37-69cf-48d5-96ff-4dba63259b29', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:22:55.945179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:22:55.945735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:22:55.946052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:22:55.946505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:22:55.946916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:22:55.957757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.958170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.959268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.959771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.978575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:22:55.982533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for user 9e50546af342492b9b6f6127b0ce2c61 and project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:22:55.996443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:22:55.998871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:22:56.087825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:56.088454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:56.100626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:56.103668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:56.104864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:56.105684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:56.157434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3ad514bf-9952-4889-ba62-115323a6c827 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.674361 Aug 02 10:22:56.158104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 98/191] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:22:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:22:56.168693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc6ae4af-7428-4bda-8d47-69dbce95474b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:56.169436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc6ae4af-7428-4bda-8d47-69dbce95474b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:56.271542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:56.281179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b852ccea-2c84-4fb6-aeba-e29009aae586 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.199803 Aug 02 10:22:56.285230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 94/192] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:56 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:56.512422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc6ae4af-7428-4bda-8d47-69dbce95474b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:56.520455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc6ae4af-7428-4bda-8d47-69dbce95474b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1221 microversion: 2.1 time: 0.355491 Aug 02 10:22:56.529352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 99/193] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:56 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1221 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:56.932832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6c3012-f7be-4b88-a45f-889e5d601451"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:56.935521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:56.942616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:56.943334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:56.944294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:56.945136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.030660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:57.032155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:57.040904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.041685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.042692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.043371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.119567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e1f343e5-e22b-41be-b1d3-0b98b691e7a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/ips" status: 200 len: 151 microversion: 2.20 time: 0.094768 Aug 02 10:22:57.120916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 100/194] 10.222.0.49 () {60 vars in 1289 bytes} [Tue Aug 2 10:22:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/ips => generated 151 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:22:57.306766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:57.307612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:57.318535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.319583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.321063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.321700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.511954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:57.521610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22dee9e7-84f9-4012-a79a-87c66f0dad4a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.219319 Aug 02 10:22:57.522188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 101/195] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:57 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:57.541572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:57.542213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:57.548481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.549179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.549903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.550420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.613721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:57.621685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34080aa1-37a8-41e7-aa76-bc0afbd6cc7f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1225 microversion: 2.1 time: 0.084008 Aug 02 10:22:57.622252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 102/196] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:57 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:58.404263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ba60be99-8817-4933-968f-444f2d117ee1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.476509 Aug 02 10:22:58.412152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 95/197] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:22:56 2022] POST /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 194 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:58.544685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:58.545362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:58.552851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.553463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.554513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.554957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.647014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:58.647738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:58.655004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.667000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.667909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.668372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.763034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:58.794349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b680c4ec-f422-4125-80ef-1d10bc4017d5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1273 microversion: 2.1 time: 0.154707 Aug 02 10:22:58.806470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 96/198] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:58 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:58.818150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:58.834838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34d12ab8-2f90-4fe7-a2b5-fa1303f1d551 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.294134 Aug 02 10:22:58.862502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 103/199] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:58 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:59.821789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:59.822671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:59.825365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=39 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:59.830234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.830674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.831460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.831952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.864048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:59.864806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:59.867671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:59.873641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.874488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.875457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.875802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.886697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:59.909717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:59.922444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-91ec3e86-1501-40a2-bacf-ca86ec708256 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1279 microversion: 2.1 time: 0.099913 Aug 02 10:22:59.922444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 97/200] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:59 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:00.223442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:00.253437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b0f4ef1d-b2bc-49a9-b35c-66611f4f2146 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.376408 Aug 02 10:23:00.253437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 104/201] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:59 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:00.942419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:00.943178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:00.951627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:00.957173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:00.958025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:00.959500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.163687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:01.171557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-285185bb-b1d5-4b8c-8c08-e326723562ea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.234428 Aug 02 10:23:01.172131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:00 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:01.263442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:01.264239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:01.271553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.271996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.272945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.273376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.326801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:01.326918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:01.337683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.338650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.340694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.341338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.374003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lazy-loading 'flavor' on Instance uuid 694dcbbc-916c-4b2a-b571-9225b4c1127f {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:01.404733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:01.609756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:01.620072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3344125-99b3-4c67-9827-6bf9610cf2c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.363085 Aug 02 10:23:01.621430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 105/203] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:01 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:01.628271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-765f838e-b873-4f1e-9518-fb3851933110 req-1a598a78-a07a-458d-962f-2d0fbbc7b7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da1d83c-cb8c-4809-a11b-6987fc2a7a6d", "name": "network-vif-plugged", "status": "completed", "tag": "eab2d499-08a8-479f-8c33-048e39479f51"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:01.643256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-765f838e-b873-4f1e-9518-fb3851933110 req-1a598a78-a07a-458d-962f-2d0fbbc7b7a0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.643684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-765f838e-b873-4f1e-9518-fb3851933110 req-1a598a78-a07a-458d-962f-2d0fbbc7b7a0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.658827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-765f838e-b873-4f1e-9518-fb3851933110 req-1a598a78-a07a-458d-962f-2d0fbbc7b7a0 service nova] Creating event network-vif-plugged:eab2d499-08a8-479f-8c33-048e39479f51 for instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d on hv-cinder-84753 Aug 02 10:23:01.666791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-765f838e-b873-4f1e-9518-fb3851933110 req-1a598a78-a07a-458d-962f-2d0fbbc7b7a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043881 Aug 02 10:23:01.670484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 106/204] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:01.823181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-685cb4d3-b730-4029-a0d5-d0027dc38922 req-2d8870d1-c772-4554-9d0c-087197db6579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b8132ed-8e07-4258-b20b-a0dbcb53bd48", "tag": "248b1799-6c6f-4c3a-9470-fb8512e2f279"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:01.834395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-685cb4d3-b730-4029-a0d5-d0027dc38922 req-2d8870d1-c772-4554-9d0c-087197db6579 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.835076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-685cb4d3-b730-4029-a0d5-d0027dc38922 req-2d8870d1-c772-4554-9d0c-087197db6579 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.854087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-685cb4d3-b730-4029-a0d5-d0027dc38922 req-2d8870d1-c772-4554-9d0c-087197db6579 service nova] Creating event network-changed:248b1799-6c6f-4c3a-9470-fb8512e2f279 for instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 on hv-cinder-84753 Aug 02 10:23:01.868885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-685cb4d3-b730-4029-a0d5-d0027dc38922 req-2d8870d1-c772-4554-9d0c-087197db6579 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049335 Aug 02 10:23:01.870022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 107/205] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:23:02.199662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:02.207531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:02.224280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.224280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.224280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.224280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.304086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83016a8a-2138-4376-8770-16bd85282b3e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action" status: 202 len: 0 microversion: 2.20 time: 0.981156 Aug 02 10:23:02.305888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 99/206] 10.222.0.49 () {62 vars in 1319 bytes} [Tue Aug 2 10:23:01 2022] POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:23:02.319590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:02.319590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:02.327106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.327593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.328835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.329913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.524706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:02.534894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-15b1625f-7d69-418d-a182-3b4aef533a39 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.339709 Aug 02 10:23:02.535542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 108/207] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:02 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:02.596990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:02.608892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:02.611129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:02.613196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a586a839-f340-47ca-ada1-e27d8370529d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.302723 Aug 02 10:23:02.614299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 100/208] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:02.649233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:02.650105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:02.656679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.657502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.659087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.659755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.143888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.153685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-424b6666-da39-4b92-a52f-8fc4a07d48b4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1318 microversion: 2.1 time: 0.508777 Aug 02 10:23:03.154269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 109/209] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:02 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:03.557629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:03.558416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:03.567252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.567782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.568658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.569339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.636786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:03.637384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:03.643505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.644186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.645113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.645733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.787926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.797595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06ede7dd-e81d-4dac-80ce-315728afb6b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.244924 Aug 02 10:23:03.799547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 101/210] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:03 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:03.826093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.838819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.841290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.842929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1d29bc16-b96b-4b52-9b9f-0c995e722126 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.209932 Aug 02 10:23:03.854537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 110/211] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:03.914791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-2fc64610-885d-4687-9304-7f72e839af0f req-ac512767-f75b-44c2-a156-db9f75c8aa9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daefd063-bf57-4fcd-b586-348ca02fcbcc", "tag": "127d8a33-053b-4a54-a6c4-64bf7744c528"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:03.944793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-2fc64610-885d-4687-9304-7f72e839af0f req-ac512767-f75b-44c2-a156-db9f75c8aa9d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.945219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-2fc64610-885d-4687-9304-7f72e839af0f req-ac512767-f75b-44c2-a156-db9f75c8aa9d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.997911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-2fc64610-885d-4687-9304-7f72e839af0f req-ac512767-f75b-44c2-a156-db9f75c8aa9d service nova] Creating event network-changed:127d8a33-053b-4a54-a6c4-64bf7744c528 for instance daefd063-bf57-4fcd-b586-348ca02fcbcc on hv-cinder-84753 Aug 02 10:23:04.021994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-2fc64610-885d-4687-9304-7f72e839af0f req-ac512767-f75b-44c2-a156-db9f75c8aa9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109508 Aug 02 10:23:04.023698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 102/212] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:04.177826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:04.179434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:04.190459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.191742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.193225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.193722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.504936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:04.520460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f7b56190-1cab-4854-8f0a-93d614a59c3f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1507 microversion: 2.1 time: 0.349653 Aug 02 10:23:04.521035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 111/213] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:04 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:04.821792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:04.825444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:04.835416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.835567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.836871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.838230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.867884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:04.868497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:04.878776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.879254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.880094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.880441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:05.047006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:05.055719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3dabaeb6-2295-488f-9e23-bb2305624db9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.238726 Aug 02 10:23:05.067732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 103/214] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:04 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:05.081517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:05.089810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:05.091344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:05.092497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ae180b0-bd06-4b59-8e36-695d7cdedb97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.228558 Aug 02 10:23:05.093048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 112/215] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:06.077417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:06.078405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:06.086017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.086462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:06.087251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.087687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:06.118400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:06.119250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:06.121934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:06.131818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.132455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:06.133744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.134672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:06.278257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:06.292158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-364efa04-63bb-4951-a969-49aa2ab91273 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.219364 Aug 02 10:23:06.306619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 104/216] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:06 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:06.314762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:06.326463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:06.328052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:06.329253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9cf7fb81-3381-4c1b-a2ad-94c525a3bcfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.214971 Aug 02 10:23:06.329917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 113/217] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:07.317704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:07.320351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:07.328075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:07.332428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:07.335481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.337114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:07.338737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.354594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:07.355225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:07.364640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=22 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:07.370713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:07.372073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.374477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:07.376914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.693072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:07.714316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:07.719455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:07.719455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b8010335-94a4-44cc-83e4-db515e3b540a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.368194 Aug 02 10:23:07.719455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 114/218] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:08.066639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:08.075578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1100968e-f169-4fa6-b0c7-55ff040fb27a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.764946 Aug 02 10:23:08.078401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 105/219] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:07 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:08.655281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d495f60-7d1c-4d3e-b946-cdbf2b78112b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: .version_select at 0x7f70c2d24820>, body: {"keypair": {"name": "tempest-keypair-1075928723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjhkOUoLlQiCXP1eeXlYE3S8J+AwulQ6cGRvPrTS+MI0jPODcc4x9Ixf+Y+hVlEBB2IsZNGwKNhN4mj04p7xtNTD5C6Fly9/1PHvsRSnVx5NDytEC+isqOl3LcJ7kzHA=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:08.670935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8d495f60-7d1c-4d3e-b946-cdbf2b78112b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:08.674706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8d495f60-7d1c-4d3e-b946-cdbf2b78112b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:08.745913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:08.746660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:08.757504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:08.757954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:08.758731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:08.759169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:08.785277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d495f60-7d1c-4d3e-b946-cdbf2b78112b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133900 Aug 02 10:23:08.786043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 115/220] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:23:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:08.931367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:08.947168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:08.947168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:08.947168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-77e33375-3306-4a44-8384-090b4b681a26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.203090 Aug 02 10:23:08.947450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 106/221] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:09.098182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:09.099090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:09.110061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.110061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.110061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.110061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.321885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:09.333059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-68df10e9-b0a2-456a-85b0-ce60fbb0dab8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.239416 Aug 02 10:23:09.345639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 116/222] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:09 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:09.768339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-e5580203-d14c-4211-9521-029aae107fdf req-927d7231-b13f-48d3-9fec-1c8626c46aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daefd063-bf57-4fcd-b586-348ca02fcbcc", "name": "network-vif-plugged", "status": "completed", "tag": "127d8a33-053b-4a54-a6c4-64bf7744c528"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:09.778415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e5580203-d14c-4211-9521-029aae107fdf req-927d7231-b13f-48d3-9fec-1c8626c46aa1 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.778862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e5580203-d14c-4211-9521-029aae107fdf req-927d7231-b13f-48d3-9fec-1c8626c46aa1 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.792074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-e5580203-d14c-4211-9521-029aae107fdf req-927d7231-b13f-48d3-9fec-1c8626c46aa1 service nova] Creating event network-vif-plugged:127d8a33-053b-4a54-a6c4-64bf7744c528 for instance daefd063-bf57-4fcd-b586-348ca02fcbcc on hv-cinder-84753 Aug 02 10:23:09.797565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-e5580203-d14c-4211-9521-029aae107fdf req-927d7231-b13f-48d3-9fec-1c8626c46aa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Aug 02 10:23:09.800163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 107/223] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:09.973373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:09.974542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:09.982794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.983805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.985026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.985640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:10.245159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:10.254263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:10.256227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:10.257857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83b90399-c897-42b9-b8b4-9d6abf6622c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.289989 Aug 02 10:23:10.258858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 117/224] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:10.359034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:10.359826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:10.367013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:10.367564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:10.368607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:10.369220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:10.552675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:10.560449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56f53cf9-5861-474c-bc4c-d9891fb0427c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.206176 Aug 02 10:23:10.561207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 108/225] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:10 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:11.285164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:11.285783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:11.292797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:11.297392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:11.297392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:11.297392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:11.533466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:11.541968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:11.543559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:11.544714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b7d383f1-5ef3-42ca-8503-a107a9e3623e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.263752 Aug 02 10:23:11.545266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 118/226] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:11.584784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:11.585421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:11.591945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:11.592395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:11.593191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:11.593624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:11.887914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:11.978774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-623be527-43bf-4268-9ec6-18b2ccad2f55 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1321 microversion: 2.1 time: 0.397048 Aug 02 10:23:11.980607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 109/227] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:11 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:12.070158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-7319a248-aade-4edc-9283-96475eb89763 req-44eae8d5-08bd-4493-b3b3-db1f54b4cb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8132ed-8e07-4258-b20b-a0dbcb53bd48", "name": "network-vif-plugged", "status": "completed", "tag": "248b1799-6c6f-4c3a-9470-fb8512e2f279"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:12.095980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7319a248-aade-4edc-9283-96475eb89763 req-44eae8d5-08bd-4493-b3b3-db1f54b4cb23 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:12.096442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7319a248-aade-4edc-9283-96475eb89763 req-44eae8d5-08bd-4493-b3b3-db1f54b4cb23 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:12.120983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-7319a248-aade-4edc-9283-96475eb89763 req-44eae8d5-08bd-4493-b3b3-db1f54b4cb23 service nova] Creating event network-vif-plugged:248b1799-6c6f-4c3a-9470-fb8512e2f279 for instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 on hv-cinder-84753 Aug 02 10:23:12.127949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-7319a248-aade-4edc-9283-96475eb89763 req-44eae8d5-08bd-4493-b3b3-db1f54b4cb23 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062601 Aug 02 10:23:12.134572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 119/228] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:12.487786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984155136", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c49660-b8e9-4548-b1ea-a7c2e86c6f47"}], "security_groups": [{"name": "tempest-securitygroup--34718481"}], "key_name": "tempest-keypair-1075928723", "user_data": "}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:12.569477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:12.570315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:12.577541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:12.578077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:12.578926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:12.579519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:12.673977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] validate_networks() for [('11c49660-b8e9-4548-b1ea-a7c2e86c6f47', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:23:12.766436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:12.783531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:12.788252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:12.788252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c388aa0-796d-49dc-b94f-6c93df654d07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.221962 Aug 02 10:23:12.788252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 120/229] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:13.007787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:13.009061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.022966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.024075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.025534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.026340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.133635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:23:13.137791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:23:13.137791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:23:13.137791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:23:13.137791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:23:13.148328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.149625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.150738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.151434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.186036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:13.192285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:13.195504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-09aa8d3d-92fa-4b0f-b0cf-2e1d2a623261 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1516 microversion: 2.1 time: 0.194690 Aug 02 10:23:13.196444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 121/230] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:12 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:13.210930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:13.225027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:23:13.228047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:23:13.228312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:13.230686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.244623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.245377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.246217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.246873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.282071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lazy-loading 'flavor' on Instance uuid daefd063-bf57-4fcd-b586-348ca02fcbcc {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:13.483840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:13.496821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83e2dae3-412b-49a6-ae57-efb17d39fe5d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.014102 Aug 02 10:23:13.504358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 110/231] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:23:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:23:13.516604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-398647d1-4455-4744-b0f6-4aaa372be880 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:13.517421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-398647d1-4455-4744-b0f6-4aaa372be880 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.681400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-398647d1-4455-4744-b0f6-4aaa372be880 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:13.692772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-398647d1-4455-4744-b0f6-4aaa372be880 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1242 microversion: 2.1 time: 0.187018 Aug 02 10:23:13.693591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 111/232] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:13 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:13.750105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a2018ec9-0ea9-40b0-a001-d60ae2386f56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc/action" status: 200 len: 32 microversion: 2.1 time: 0.532860 Aug 02 10:23:13.751437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 122/233] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:23:13 2022] POST /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc/action => generated 32 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:23:13.760611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:13.761293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.771521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.771979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.772763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.773197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.810410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:13.811778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.825369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.827285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.829986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.833795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:14.017744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.034565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.037262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.043436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8990c4fe-705f-4ff1-ae9f-7e1ea6633e3b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.235911 Aug 02 10:23:14.046883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 123/234] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:14.072935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.089780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-300d5692-2a13-4eab-8d5a-815e1131ecad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.332917 Aug 02 10:23:14.090951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 112/235] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:13 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:14.720618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-10df2cb2-68f3-4b22-afb5-25564aa279c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:14.721247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-10df2cb2-68f3-4b22-afb5-25564aa279c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:14.859086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-10df2cb2-68f3-4b22-afb5-25564aa279c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.877169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-10df2cb2-68f3-4b22-afb5-25564aa279c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1242 microversion: 2.1 time: 0.163207 Aug 02 10:23:14.887220 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 124/236] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:14 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:15.074036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.081371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.105686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.107341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.108399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.113200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.127165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.127165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.140194 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.143131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.144184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.146425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.505730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:15.520208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:15.521757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:15.522967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0fe5bff7-131d-44da-8ae0-45f695c2283c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.453569 Aug 02 10:23:15.547346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 113/237] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:15.776315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:15.788756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb992797-fe2b-4de0-b9b7-d726659aeb51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.680209 Aug 02 10:23:15.802297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 125/238] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:15 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:15.899129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.899785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.906594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.907059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.907901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.908337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.033244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:16.053557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88d4d6e4-3f06-4b88-a75a-ac7f24da255e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1294 microversion: 2.1 time: 0.158054 Aug 02 10:23:16.061648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 114/239] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:15 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:16.549313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:16.550012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:16.565821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.567143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.570224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.570730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.813295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:16.813966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:16.824530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.824992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.825786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.831979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.948297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:16.972290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:16.987776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:16.987776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47a54bc0-52e1-4755-85f3-5ac3789d25df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.439234 Aug 02 10:23:16.987776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 126/240] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:17.081347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:17.082045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:17.092642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.093095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:17.104329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.104797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:17.271950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:17.283347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8bee3712-93f7-4b3e-a654-70c64ada69be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.476458 Aug 02 10:23:17.283985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 115/241] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:16 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:17.301869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:17.314586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d15de44e-e4c3-48ca-97b3-a8253a3a762a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1312 microversion: 2.1 time: 0.240052 Aug 02 10:23:17.315237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 127/242] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:17 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:18.014046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:18.014871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:18.024338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.025217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.026348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.027084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.307947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.316920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:18.317533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:18.319633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.321766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.333316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.333846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.334709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.335348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.335684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9accec5d-b9e2-4cc6-a315-4c4642f505aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1721 microversion: 2.20 time: 0.325290 Aug 02 10:23:18.336814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 116/243] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:18.343327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:18.344478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:18.382510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.383297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.386086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.391444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.459928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:18.767592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.780544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eef79af7-14f3-4937-8882-a01f05a0c853 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.442435 Aug 02 10:23:18.781219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 117/244] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:18 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:18.852843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.863284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-501cc206-20e4-4ea0-bc2d-253d1ec2ad9b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.555835 Aug 02 10:23:18.865740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 128/245] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:18 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:19.361208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.362899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.381341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.382784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.387286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.387817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.758171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:19.768901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:19.770531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:19.777545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb4f7a04-690c-49e2-a88c-88e183572fe9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1742 microversion: 2.20 time: 0.415313 Aug 02 10:23:19.786668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 118/246] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1742 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:19.802559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.803219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.810022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.810910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.811899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.812693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.890213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.890980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.906414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.906862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.909304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.909304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.005710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:20.018022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-12ef2e42-3430-4777-8dba-c6aac2af0ae3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.219880 Aug 02 10:23:20.018610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 129/247] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:20.128476 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-5344523f-8dc6-42a7-867a-4e926a1dcd29 req-39e1fab3-64d1-4e89-b637-0c465201e273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da557b6b-b710-411d-94ef-d1d2a2bde8cc", "tag": "7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:20.143993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5344523f-8dc6-42a7-867a-4e926a1dcd29 req-39e1fab3-64d1-4e89-b637-0c465201e273 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.144736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5344523f-8dc6-42a7-867a-4e926a1dcd29 req-39e1fab3-64d1-4e89-b637-0c465201e273 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.160491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-5344523f-8dc6-42a7-867a-4e926a1dcd29 req-39e1fab3-64d1-4e89-b637-0c465201e273 service nova] Creating event network-changed:7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f for instance da557b6b-b710-411d-94ef-d1d2a2bde8cc on hv-cinder-84753 Aug 02 10:23:20.161473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:20.166756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-5344523f-8dc6-42a7-867a-4e926a1dcd29 req-39e1fab3-64d1-4e89-b637-0c465201e273 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042932 Aug 02 10:23:20.168329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 130/248] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:20.170968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ea4a66b-8f0f-47f7-b494-32d302afd7a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.284771 Aug 02 10:23:20.199627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 119/249] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:20.819128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:20.819896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:20.833511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.833511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.833511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.833511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.041292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:21.041969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:21.053780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.054247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.055037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.055753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.125732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.138534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.140295 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.142361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edc084b0-7c45-4d74-980e-8468d30183cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1742 microversion: 2.20 time: 0.327132 Aug 02 10:23:21.157941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 131/250] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1742 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:21.192361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:21.192997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:21.202696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.203148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.204313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.204751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.243257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.255013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-09db6f35-c561-4e16-beed-c78e64cf9a48 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.216233 Aug 02 10:23:21.256376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 120/251] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:21 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:21.396709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.404817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d466b38e-dbd1-4b3f-afb7-3544bb75ff2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.216891 Aug 02 10:23:21.405683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 132/252] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:21 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:22.166265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:22.166722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:22.173881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.174385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.175548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.176200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.288587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:22.289891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:22.302087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.306562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.307173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.307645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.396784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.406617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.410086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.411753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1ecba054-e470-4fcd-8643-bfe1dac10d33 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1742 microversion: 2.20 time: 0.249475 Aug 02 10:23:22.412867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 121/253] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1742 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:22.427411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:22.428373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:22.444203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.445094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.446069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.446668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.774360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.774360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fcd63c42-6a2c-40cf-b8a9-275b0c6ebb34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.226232 Aug 02 10:23:22.774360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 133/254] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:22 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:22.775523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.775523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ea503a57-b691-49c8-809f-591c3ae2bcba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.177254 Aug 02 10:23:22.775523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 122/255] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:22 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:23.256438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d000d00-e128-45b4-a0cd-474b8d4991a8", "device": "/dev/sdb"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:23.261589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:23.271811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.284840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.289159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.290461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.437686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:23.438673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:23.442138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:23.448172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.448857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.449901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.450360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.690814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:23.697001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=8 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:23.709383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:23.711208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:23.712444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-13422efc-ab8b-42c3-bb69-bba0c38209e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1742 microversion: 2.20 time: 0.279508 Aug 02 10:23:23.712996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 123/256] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1742 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:23.718349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-bd1279d3-ad84-4378-a92e-27916cca495e req-8f79a6cb-26b8-4fd0-938c-6b62044853d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "name": "network-vif-plugged", "status": "completed", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:23.731092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-bd1279d3-ad84-4378-a92e-27916cca495e req-8f79a6cb-26b8-4fd0-938c-6b62044853d8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.731559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-bd1279d3-ad84-4378-a92e-27916cca495e req-8f79a6cb-26b8-4fd0-938c-6b62044853d8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.745086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-bd1279d3-ad84-4378-a92e-27916cca495e req-8f79a6cb-26b8-4fd0-938c-6b62044853d8 service nova] Creating event network-vif-plugged:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:23:23.750527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-bd1279d3-ad84-4378-a92e-27916cca495e req-8f79a6cb-26b8-4fd0-938c-6b62044853d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036395 Aug 02 10:23:23.751782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 124/257] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:23.777366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:23.778020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:23.800273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.803317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.804369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.805035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.971119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:23.980788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a79126de-6589-47f1-a50c-bf8ceafad419 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.207977 Aug 02 10:23:23.981518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 125/258] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:23 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:24.004364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:24.004993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:24.013501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.015465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.017683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.018145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.182490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.192062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-37c65c17-e66d-4a5b-b2dd-9f5787afccfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.195142 Aug 02 10:23:24.204318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 126/259] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:23 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:24.337597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c9c59461-393e-40be-97e7-df2701cb5fc1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "POST /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.090194 Aug 02 10:23:24.339405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 134/260] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:23:23 2022] POST /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d/os-volume_attachments => generated 194 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:24.738248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:24.738868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:24.745642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.746085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.747053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.747508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.928383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.937858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.939508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.940700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-600c7df2-adbd-4037-8656-54adc1f41c5b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.208172 Aug 02 10:23:24.941402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 127/261] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:25.000586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:25.005166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:25.006529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:25.015619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.016284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.017909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.018527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.217903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:25.218817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:25.227265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.230377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.230377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.230596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.393041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:25.402142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5e6390b2-9b3b-4c10-98a5-b4f1a10f86c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.191024 Aug 02 10:23:25.402349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 128/262] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:25 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:25.519358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:25.527903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc9a8707-b5c7-4be7-867d-cfc2e7dd1a47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.528629 Aug 02 10:23:25.528475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 135/263] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:24 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:25.965894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:25.966529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:25.973525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.973967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.974728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.975158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.122699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.134418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.136577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.141594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ce06f234-2ec6-4095-a110-5dc5101686f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.176064 Aug 02 10:23:26.141594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 129/264] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:26.422081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:26.423093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:26.441706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.442533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.443562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.444770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.549587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:26.550326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:26.560718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.561164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.561967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.564881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.757682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.767419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ea8b967-fb5c-4555-88ef-cea227c5cf68 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.348561 Aug 02 10:23:26.768112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 136/265] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:26 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:26.777186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.787434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-898233d9-7e98-4071-aa76-8a004a820eb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.241065 Aug 02 10:23:26.787434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 130/266] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:26 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:27.165457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:27.166153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:27.176461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.176918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.177742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.181360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.765434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:27.788070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:27.790986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:27.792179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:27.793538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:27.794964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fed35c9e-b1e2-4b41-9412-733c2c464965 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.634338 Aug 02 10:23:27.803239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 137/267] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:27.821809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:27.822491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:27.830661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.831113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.836030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.836030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.836269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.836269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.836269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.842327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:28.165767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:28.178972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5433790-a3a9-4bc9-8196-5af4405e5f35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.391490 Aug 02 10:23:28.180176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 131/268] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:27 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:28.209186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:28.215908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:28.221500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-74ea9d01-a53f-4632-bed1-79ae2113a1b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.402782 Aug 02 10:23:28.226451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 138/269] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:27 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:28.823362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:28.824788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:28.837083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:28.838556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:28.841038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:28.841724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:29.114079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.127452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.129774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.131997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4d9a2ef-289e-4102-9060-fb7d4946c4dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.313643 Aug 02 10:23:29.147224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 132/270] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:29.202259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:29.202994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:29.211355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:29.212190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:29.213209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:29.213862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:29.246719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:29.246719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:29.261086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:29.264851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:29.273107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:29.275319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:29.606547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.615163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-73d967ab-43a8-48e2-a447-066c95948ed8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.373005 Aug 02 10:23:29.632964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 133/271] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:29 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:29.646128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.664653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b780d6f-75e6-44b9-a566-2335cad44fa0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.464717 Aug 02 10:23:29.665856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 139/272] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:29 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:30.159496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.161270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.171673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.176170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.177906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.178602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.516740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.518795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:30.526973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.541362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.546248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8be52351-8771-4131-b566-865bc7d4d436 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.392231 Aug 02 10:23:30.549738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 134/273] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:30.657861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.660123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.672312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.673653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.675128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.678505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.686989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.687734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.705765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.705765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.707037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.707597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.897172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.905561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4674529b-0198-4ebc-b34e-cb409e4b87b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.256063 Aug 02 10:23:30.908797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 140/274] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:30 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:30.949608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.969534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f489aa7a-c34e-415e-9a66-215841850b16 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.281516 Aug 02 10:23:30.973385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 135/275] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:30 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:31.580688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:31.583715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:31.594110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.594726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.597026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.597781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.868102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:31.877118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:31.879503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:31.881083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e13c929a-2c39-4ba9-8f95-57d24f8c9d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.307964 Aug 02 10:23:31.897808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 141/276] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:31.930320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:31.932030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:31.940539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:31.942760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.943558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.944895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.946319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.007904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:32.008553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:32.018931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.035872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.036989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.037516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.162702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:32.173905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bd24cc37-7176-44c4-9c8f-e5d83da30e72 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.248172 Aug 02 10:23:32.174592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 136/277] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:31 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:32.274017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:32.284109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-451bfa19-de73-41e8-9c14-e1b600d22795 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.280120 Aug 02 10:23:32.285138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 142/278] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:32 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:32.656391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-09dbe542-0586-4b25-a519-226b9774c3c1 req-a44695e9-d3f2-4f79-be28-70bc57341328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da557b6b-b710-411d-94ef-d1d2a2bde8cc", "name": "network-vif-plugged", "status": "completed", "tag": "7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:32.685819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-09dbe542-0586-4b25-a519-226b9774c3c1 req-a44695e9-d3f2-4f79-be28-70bc57341328 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.685979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-09dbe542-0586-4b25-a519-226b9774c3c1 req-a44695e9-d3f2-4f79-be28-70bc57341328 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.741412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-09dbe542-0586-4b25-a519-226b9774c3c1 req-a44695e9-d3f2-4f79-be28-70bc57341328 service nova] Creating event network-vif-plugged:7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f for instance da557b6b-b710-411d-94ef-d1d2a2bde8cc on hv-cinder-84753 Aug 02 10:23:32.751356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-09dbe542-0586-4b25-a519-226b9774c3c1 req-a44695e9-d3f2-4f79-be28-70bc57341328 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099208 Aug 02 10:23:32.767423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 137/279] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:32.905497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:32.906463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:32.937452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.937941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.939272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.939735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:33.201852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:33.203105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:33.224617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:33.226636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:33.226636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:33.232364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:33.418744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.435805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.437616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.450880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-775d1c74-6a49-467f-9ba9-4e30a5e27d0e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.541130 Aug 02 10:23:33.452124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 143/280] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:33.458070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:33.459943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:33.475242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:33.477413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:33.479977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:33.483940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:33.638711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.651857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-50104b89-2c2f-469f-a280-8484cdb2c794 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.454679 Aug 02 10:23:33.655153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 138/281] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:33 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:33.811068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.826002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4f1e176-2b06-4a89-83d7-fd5e21dc138d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.372526 Aug 02 10:23:33.835835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 144/282] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:33 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:34.484770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.486118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.498006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.498736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.500074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.502887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.675165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.676564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.680294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:34.689178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.690006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.700934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.702362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.935500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:34.952766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:34.964905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:34.970728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-25e859ec-ae5b-4e7b-9e08-6030166dd3c0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.490170 Aug 02 10:23:34.970728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 139/283] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:35.020613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:35.021885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:35.042676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.043177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.049653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.050910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.285614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:35.293856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ef7292dd-023e-468e-8de4-dc3fe6e8bbe6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.623687 Aug 02 10:23:35.297587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 145/284] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:35.508571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:35.523954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0015a89b-2040-4cc9-b109-157519da39af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.552616 Aug 02 10:23:35.524962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 140/285] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:36.018398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:36.019019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:36.031588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.033038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.046320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.047211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.313344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.317809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:36.318933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:36.330479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.330479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.331326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-24e39ee4-82cf-4c8a-94ea-63e1805b203d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.317313 Aug 02 10:23:36.332076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 146/286] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:36.336814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.339170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.343856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.346369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.558052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:36.558052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:36.568270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.569262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.572378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.573499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.678504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.678504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06bff7b0-7997-46fa-89a1-7b6807c8f54a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.333114 Aug 02 10:23:36.678504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 141/287] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:36 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:36.779064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.788975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61889d49-ca3b-4ff6-bb75-78776a997e1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.246761 Aug 02 10:23:36.789912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 147/288] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:36 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:37.356490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:37.357513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:37.365271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.365929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.366820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.367280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.546452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.546452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.547394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.547394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-362be179-e93c-4405-905a-3ea2c19e555d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.178478 Aug 02 10:23:37.547394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 142/289] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:37.667969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:37.679289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:37.679289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.679289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.679289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.680103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.818811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:37.819695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:37.826269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.826714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.827635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.828064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.849158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.865042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8478a641-6a96-4b6e-9cb1-3d27601df336 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.200741 Aug 02 10:23:37.865985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 148/290] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:37 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:38.025578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.035719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fc61a2d4-df4d-4742-b106-87e741b8b3fd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.223571 Aug 02 10:23:38.049598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 143/291] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:37 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:38.562047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:38.562047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:38.574997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.575491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.576281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.576717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.789981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.804843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.807021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.808508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-48a7ba71-ac50-4ec0-bda8-2470b80ba0d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.251078 Aug 02 10:23:38.809658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 149/292] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:38.886265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:38.887482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:38.902869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.903641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.904597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.905180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.057267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:39.058259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:39.071360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.072246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.073275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.074608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.241432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:39.253102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2b85a8fa-7b92-42ed-93eb-6571e1b95a83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.370683 Aug 02 10:23:39.269684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 144/293] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:38 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:39.341624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:39.355141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1037d7c0-572e-4d0c-834e-b3ead9e5dc57 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.301648 Aug 02 10:23:39.356140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 150/294] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:39 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:39.838165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:39.839247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:39.851629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.852507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.866792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.870138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.165656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.167606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.169052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-addb4158-5cdf-4193-befb-fa114c246678 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.334996 Aug 02 10:23:40.183588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 145/295] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:40.279641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:40.281007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:40.298469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:40.299822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.300838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:40.301963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.394257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:40.394257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:40.394257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:40.394257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.397204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:40.399293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.679142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.693078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-02b59050-5b76-41a6-a187-e706e5bbae09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.418994 Aug 02 10:23:40.693934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 151/296] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:40 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:40.765272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.777116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4a217ff5-3b85-4133-bb33-13bc7dc96276 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.402419 Aug 02 10:23:40.777116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 146/297] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:40 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:41.204720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:41.204720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:41.204720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.211729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.212237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.212758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.460482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.471762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.473610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.475121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6d6d6e1b-851c-46fe-a72f-6512813bc9d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.284862 Aug 02 10:23:41.475738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 152/298] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:41.717688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:41.719065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:41.727767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.728216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.729043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.729477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.803406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:41.805455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:41.812211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.812814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.813629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.814129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.883161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.891380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b662edb2-4200-4b0b-a025-8e8a730c6a19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.177773 Aug 02 10:23:41.894881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 147/299] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:41 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:41.964604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.972861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4b31c934-80ad-40b2-a4a5-557c5b8cd3ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.178719 Aug 02 10:23:41.973354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 153/300] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:41 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:42.498185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:42.498869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:42.505894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.506349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.507148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.507619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.642270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:42.650396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:42.651938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:42.653121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2f7d779f-160d-497a-88d5-343fb4a7b440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.159093 Aug 02 10:23:42.653673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 148/301] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:42.914356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:42.915137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:42.922303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.924278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.924278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.924728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.996540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:42.997975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:43.010890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.014084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.015174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.015801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.093860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.105290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7e93d5dd-77db-4c6f-9ee1-950cdfeb2f07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.195586 Aug 02 10:23:43.116267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 154/302] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:42 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:43.210218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.218357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11cc8755-38d3-41c5-9fb5-2cd5e93fcd3d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.227775 Aug 02 10:23:43.227251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 149/303] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:42 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:43.685216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:43.685832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:43.694414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.695515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.696371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.696834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.712479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:43.853020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.865411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.867635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.870897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c73dd43c-97df-4e82-ae29-ee27d29c64cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.188052 Aug 02 10:23:43.870897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 155/304] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:44.139673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:44.151681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:44.151681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.151681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.151681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.152111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.246138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:44.247371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:44.258481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.262005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.264172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.264626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.351243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:44.360734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56d90822-d226-4b26-9c99-941bcb6d9e3f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1366 microversion: 2.1 time: 0.224928 Aug 02 10:23:44.361672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 150/305] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:44 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:44.443139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:44.451892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4466484-d445-4ea7-89e1-b77cc875b00f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.209860 Aug 02 10:23:44.456610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 156/306] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:44 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:44.896276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:44.896961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:44.904230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.904668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.912618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.914488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.124690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.135432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.137113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.138540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d75be58-6b01-468b-bd36-65c440215568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1737 microversion: 2.20 time: 0.247227 Aug 02 10:23:45.139122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 151/307] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:45.384516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:45.385887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:45.399398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.400489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.401969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.402474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.478758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:45.479406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:45.491156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.492001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.493112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.493996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.498518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:45.731493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.740049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-09ee7789-bb4d-4fb3-a969-d9d24644d034 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.265853 Aug 02 10:23:45.742261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 152/308] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:45 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:45.763701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.773453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9fbd8ff1-779e-4434-84bd-908a7341c495 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1556 microversion: 2.1 time: 0.393731 Aug 02 10:23:45.774678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 157/309] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:45 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1556 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:45.796551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:45.797381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:45.804574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.805046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.805823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:45.806286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.925464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0e73072d-e16c-40d8-a73f-afc1387a177d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132795 Aug 02 10:23:45.926822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 153/310] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:23:45 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:46.164699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:46.165710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:46.171996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:46.172444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:46.173250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:46.173711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:46.437139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:46.446291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:46.457717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:46.457717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a8cdaac-1752-422a-9da6-a3116189055e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.288263 Aug 02 10:23:46.457717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 158/311] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:46.764843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:46.765461 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:46.772023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:46.772476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:46.773234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:46.773666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:46.921446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:46.929686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ebc7abb-0e27-4486-b06a-c5153b50626a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.169277 Aug 02 10:23:46.930488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 154/312] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:46 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:47.483652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:47.485214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:47.495341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.496440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:47.499077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.499747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:47.747602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-ee4bd51b-9a58-43ec-adcb-41ab35bdb6ef req-d0cb69cb-2200-4d22-9a5c-95a63eecd05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da557b6b-b710-411d-94ef-d1d2a2bde8cc", "tag": "7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:47.768274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ee4bd51b-9a58-43ec-adcb-41ab35bdb6ef req-d0cb69cb-2200-4d22-9a5c-95a63eecd05e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.768960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-ee4bd51b-9a58-43ec-adcb-41ab35bdb6ef req-d0cb69cb-2200-4d22-9a5c-95a63eecd05e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:47.774524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:47.785173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:47.786393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-ee4bd51b-9a58-43ec-adcb-41ab35bdb6ef req-d0cb69cb-2200-4d22-9a5c-95a63eecd05e service nova] Creating event network-changed:7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f for instance da557b6b-b710-411d-94ef-d1d2a2bde8cc on hv-cinder-84753 Aug 02 10:23:47.786885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:47.788133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b4fa3ec-8c8b-49c3-afb7-35a57dde4d70 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.318418 Aug 02 10:23:47.792692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-ee4bd51b-9a58-43ec-adcb-41ab35bdb6ef req-d0cb69cb-2200-4d22-9a5c-95a63eecd05e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048738 Aug 02 10:23:47.796629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 155/313] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:47.803510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 159/314] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:47.952913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:47.953847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:47.962726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.963180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:47.964083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.964525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:48.118960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:48.127346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5fb3a74e-96cf-4e7d-9b97-a389142a726d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.179840 Aug 02 10:23:48.128980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 156/315] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:47 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:48.169067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ccc9aa10-04da-41a2-a6fb-27d8739ddd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'create', calling method: .version_select at 0x7f70c2f0e790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-547173960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBblQ/fIiIzcn34TSjTKGRz+iwVsatAREk+KbbBC8thHcxs1SxtM1gbwzivKMVt6oMu3/cTOjM+3Pzwclc8M0S/aS8chYRBvxfdVdb6sosYNjzIp1dZaRn+qazCMPW338g=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:48.206392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-ccc9aa10-04da-41a2-a6fb-27d8739ddd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Getting quotas for project 4f52a818be854bce9ba1c1405bab4a6c. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:48.212224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-ccc9aa10-04da-41a2-a6fb-27d8739ddd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Getting quotas for user c0fc81b95f6d41bf843bf9aadabcda9d and project 4f52a818be854bce9ba1c1405bab4a6c. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:48.328833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ccc9aa10-04da-41a2-a6fb-27d8739ddd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.164021 Aug 02 10:23:48.329974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 160/316] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:23:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:48.500547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-620317284", "imageRef": "6149c061-07c7-481d-841b-dab2a21979b8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-547173960", "networks": [{"uuid": "88f6f0cd-66be-48bc-806e-d338c3638275"}]}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:48.582471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] validate_networks() for [('88f6f0cd-66be-48bc-806e-d338c3638275', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:23:48.810788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:48.811420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:48.818190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:48.818634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:48.819433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:48.819864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:49.054395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:23:49.055519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:23:49.057159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:23:49.058179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:23:49.058828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:23:49.070408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:49.071168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:49.072420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:49.073240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:49.098078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Getting quotas for project 4f52a818be854bce9ba1c1405bab4a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:49.103665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Getting quotas for user c0fc81b95f6d41bf843bf9aadabcda9d and project 4f52a818be854bce9ba1c1405bab4a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:49.120264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:23:49.127925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6149c061-07c7-481d-841b-dab2a21979b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:23:49.273696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99d536dd-40f6-4aea-af09-bd1a31e34b37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778711 Aug 02 10:23:49.274963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 157/317] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:23:49.280721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:49.281833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:49.290246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:49.291031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:49.292158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:49.292938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:49.475510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:49.487249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:49.490374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:49.491508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f96e8623-2aa6-4d76-a1cf-890ef3930edf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.684674 Aug 02 10:23:49.492059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 161/318] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:49.499121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8935843a-81c1-44d0-8a60-b3dc4c204021 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:49.500040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8935843a-81c1-44d0-8a60-b3dc4c204021 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:49.541183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:49.549692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-25f74b98-f89c-46a6-8b2a-f4baa84af89e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.273331 Aug 02 10:23:49.550388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 158/319] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:49 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:49.632192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8935843a-81c1-44d0-8a60-b3dc4c204021 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:49.639215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8935843a-81c1-44d0-8a60-b3dc4c204021 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1257 microversion: 2.1 time: 0.143867 Aug 02 10:23:49.640051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 162/320] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1257 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:50.321146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-99d01aac-674c-4076-b37a-6a349ea50e5a req-af501a84-6e89-474d-bfe6-7a92f6755d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "name": "network-vif-unplugged", "status": "completed", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:50.333001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-99d01aac-674c-4076-b37a-6a349ea50e5a req-af501a84-6e89-474d-bfe6-7a92f6755d51 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:50.333484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-99d01aac-674c-4076-b37a-6a349ea50e5a req-af501a84-6e89-474d-bfe6-7a92f6755d51 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:50.344522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-99d01aac-674c-4076-b37a-6a349ea50e5a req-af501a84-6e89-474d-bfe6-7a92f6755d51 service nova] Creating event network-vif-unplugged:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:23:50.350113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-99d01aac-674c-4076-b37a-6a349ea50e5a req-af501a84-6e89-474d-bfe6-7a92f6755d51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032771 Aug 02 10:23:50.350693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 159/321] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:50.518139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:50.519085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:50.526496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:50.526939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:50.527806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:50.528559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:50.571856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:50.572734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:50.580320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:50.582812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:50.582812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:50.582812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:50.672494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:50.681110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:50.682648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:50.683829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e06fa9c2-c4f0-4f30-8896-be333e023c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.170378 Aug 02 10:23:50.684376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 163/322] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:50.689506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7c86c9f-995b-44ff-8631-2032dff466cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:50.690112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7c86c9f-995b-44ff-8631-2032dff466cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:50.727897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:50.735644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c5304d6-7f55-425b-bf97-349e1d333671 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.169389 Aug 02 10:23:50.737219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 160/323] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:50 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:50.741954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7c86c9f-995b-44ff-8631-2032dff466cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:50.748870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7c86c9f-995b-44ff-8631-2032dff466cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1257 microversion: 2.1 time: 0.063389 Aug 02 10:23:50.749415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 164/324] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:51.707486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:51.708099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:51.714788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.715260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.716050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.716489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.756926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:51.757544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:51.765320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.766056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.766832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.767311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.854764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.864103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.865846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.867322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6eb857b-9ea6-4c69-b2cc-1a08ff77eccc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.163948 Aug 02 10:23:51.868646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 161/325] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:51.873498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:51.874176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:51.880386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.880861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.881688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.882205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.916701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.928568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-78a912d9-604b-46fd-8e97-35f17773e602 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.175418 Aug 02 10:23:51.929459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 165/326] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:51 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:51.948042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.955965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3f578048-7f74-4c7d-9060-fe8c02ced4e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1261 microversion: 2.1 time: 0.085964 Aug 02 10:23:51.956537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 162/327] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:52.892353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:52.895243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:52.899604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.900045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:52.900800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.901229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:52.954617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:52.954617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:52.960852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.961616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:52.963156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.964797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:53.076864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:53.086635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:53.088197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:53.089349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-430ccc98-8109-4a62-8249-f33092bb91af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1719 microversion: 2.20 time: 0.201008 Aug 02 10:23:53.090188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 166/328] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:53.106409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:53.107046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:53.114104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:53.114552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:53.115375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:53.115809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:53.166416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:53.174799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3f93972-59ba-4684-8db6-d9646a5548f8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.228697 Aug 02 10:23:53.181186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 163/329] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:52 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:53.184581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:53.195768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8404d11a-ed9f-4440-ad86-bc11a909d9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1261 microversion: 2.1 time: 0.101445 Aug 02 10:23:53.195768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 167/330] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:54.113707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:54.114326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:54.121390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.121967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.122945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.123518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.198493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:54.200140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:54.206985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.207467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.208259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.211602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.301322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.310619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.313288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.315429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e9a3ade-c904-4f53-9e1d-ae4020fe87d6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1722 microversion: 2.20 time: 0.206504 Aug 02 10:23:54.318480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 164/331] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:54.331148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:54.332105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:54.342094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.342737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.343719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.344373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.387643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.405125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d9ae060a-d119-43ce-8f07-86ba3aa78c7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.212736 Aug 02 10:23:54.405709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 168/332] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:54 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:54.410860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd43e4d1-4601-492e-a3c0-d7cc13bd6f89"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:54.414003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:54.422755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.427092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.427092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.427092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.427092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.431955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6067ffb0-9224-4baa-9006-3d472a52d780 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1309 microversion: 2.1 time: 0.114185 Aug 02 10:23:54.432548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 165/333] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:55.427043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:55.427857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:55.436272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.436846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.443881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.443881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.614566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:55.622592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e61be5ac-828a-4f97-972e-5dd3b520025a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.200707 Aug 02 10:23:55.636903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 166/334] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:55 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:55.641774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:55.642392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:55.649292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.649750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.650607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.651032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.740671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:55.751231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e0dd44ca-4c79-4d56-95ab-6cd6c56d9432 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1315 microversion: 2.1 time: 0.113098 Aug 02 10:23:55.751804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 167/335] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1315 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:55.981625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a00c6c18-f431-42bd-be3b-be1aee11f867 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.573502 Aug 02 10:23:55.981625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 169/336] 10.222.0.49 () {62 vars in 1364 bytes} [Tue Aug 2 10:23:54 2022] POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 188 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:23:56.151404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:56.152059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:56.160763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.161207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.161976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.162460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.220984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118452) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 10:23:56.622533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-92e899c8-e6b9-468b-a925-adc2b1332155 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action" status: 202 len: 0 microversion: 2.20 time: 0.479446 Aug 02 10:23:56.628421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 168/337] 10.222.0.49 () {62 vars in 1319 bytes} [Tue Aug 2 10:23:56 2022] POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:23:56.656175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:56.658192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:56.664251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:56.669118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:56.685867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.687597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.691530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.692248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.694744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.700834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.707156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.708293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.057247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.081957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30ba5050-72d0-42c3-82b2-8c3429fd76e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.436098 Aug 02 10:23:57.084678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 169/338] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:56 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:57.085179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.090111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:57.092502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:57.100478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.101379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.102399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.103069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.104516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.108252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:57.109983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.111858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f081ea58-f0e5-43f3-8afe-b6845ed106b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.478903 Aug 02 10:23:57.125592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 170/339] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:57.356210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.369324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1867bf4-7e61-4b1c-9c88-99031d35a39c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.283422 Aug 02 10:23:57.369970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 170/340] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:57.643407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-39cfb4a9-b389-4613-a4ff-df82ac78b8ae req-1ea31254-26d2-4d35-8836-433a184dd9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:57.655383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-39cfb4a9-b389-4613-a4ff-df82ac78b8ae req-1ea31254-26d2-4d35-8836-433a184dd9ef service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.656570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-39cfb4a9-b389-4613-a4ff-df82ac78b8ae req-1ea31254-26d2-4d35-8836-433a184dd9ef service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.673972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-39cfb4a9-b389-4613-a4ff-df82ac78b8ae req-1ea31254-26d2-4d35-8836-433a184dd9ef service nova] Creating event network-changed:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:23:57.680463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-39cfb4a9-b389-4613-a4ff-df82ac78b8ae req-1ea31254-26d2-4d35-8836-433a184dd9ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043547 Aug 02 10:23:57.681645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 171/341] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:57.987691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:57.989122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:57.997764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.998364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.999478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.000144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.112673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:58.114421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:58.125469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.126012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.128118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.128806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.177320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:58.401575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.411396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7fa121f-6a2c-4080-ae02-a63686570581 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.303718 Aug 02 10:23:58.421612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 172/342] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:58 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:58.421612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:58.421612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:58.424463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.425116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.426063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.426653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.431615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:58.590549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.601478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.603420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.604731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bfa1c714-6707-4aa6-b3d7-00f3f04a5695 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.191556 Aug 02 10:23:58.605377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 173/343] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:23:58.610206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:58.611017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:58.618547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.619374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.620422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.621076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.870138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.870138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-725f4e5f-a2d3-4c60-a2f7-808e5e0554ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.191608 Aug 02 10:23:58.870138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 174/344] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:59.085677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:59.111415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:59.122513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c032df0-9ccc-4d81-908f-aacd555e36e3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d/os-volume_attachments/0d000d00-e128-45b4-a0cd-474b8d4991a8" status: 202 len: 0 microversion: 2.1 time: 1.139474 Aug 02 10:23:59.127779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 171/345] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:23:57 2022] DELETE /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d/os-volume_attachments/0d000d00-e128-45b4-a0cd-474b8d4991a8 => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:23:59.442944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:59.444130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:59.452559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.453030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.453800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.454235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.633191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:59.633762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:59.643734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.652869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.652869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.652869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.707249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:59.716425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc2ab446-7979-4345-8d7a-badddbb33c47 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.284393 Aug 02 10:23:59.720857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 175/346] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:59 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:59.821139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:59.830058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:59.831609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:59.832782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-142f85aa-b157-4785-8b53-130a70a2bbd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.204819 Aug 02 10:23:59.833339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 172/347] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:23:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:23:59.889992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:59.890576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:59.898054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.898501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.900269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.900926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:00.103114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:00.113997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89511faa-f226-4321-a94c-14516f5156e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.227826 Aug 02 10:24:00.114920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 176/348] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:00.739719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:00.740538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:00.751973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:00.752758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:00.753578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:00.754013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:00.856800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:00.857436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:00.880102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:00.897278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:00.897726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:00.898523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:00.901808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:01.005062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.013616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a80177fd-34de-432a-92ca-248b49ce61ca tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.279223 Aug 02 10:24:01.027280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 173/349] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:00 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:01.067313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.077654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.080206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.081633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-06f48afa-eb7b-45d3-a81c-8fc054f07fb6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.229380 Aug 02 10:24:01.082771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 177/350] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:01.146614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:01.147572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:01.156370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:01.158140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:01.159146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:01.159732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:01.464548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.473036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-89ef3271-9b1c-406b-b678-e3e650839e8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.337057 Aug 02 10:24:01.476049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 174/351] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:02.044587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:02.045229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:02.053409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.053853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.054619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.055055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.106033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:02.111456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:02.117486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:02.128876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.129726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.132208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.136608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.246198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.258129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-071d1bb9-490a-48ce-9583-761bd2c07eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.223500 Aug 02 10:24:02.263662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 178/352] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:02 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:02.321618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.331064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.332731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.333988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a611cd4e-ffff-4c6d-9fdf-178edb8832a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.231981 Aug 02 10:24:02.335066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 175/353] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:02.498002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:02.498617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:02.518047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.518617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.519509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.519957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.725380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.734103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0cebdc0f-acd1-4f54-a582-32a351b3ec61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.239833 Aug 02 10:24:02.736100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 179/354] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:03.282065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:03.283284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:03.302813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.303882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.305877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.306695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.364462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:03.365885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:03.377340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.392605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.393865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.400755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.556344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:03.568779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3792a4c-5f58-4d23-91ce-385ccdaa49bb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.292492 Aug 02 10:24:03.573346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 176/355] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:03 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:03.699647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:03.715556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:03.718556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:03.720747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-02d5733f-75c8-47d4-8ef3-056b6a72b8ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.366807 Aug 02 10:24:03.736336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 180/356] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:03.784773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:03.784773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:03.795149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.795632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.796411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.796847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.075518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:04.084290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9736a69a-05e1-4c61-94e7-ba6a53581b24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.320851 Aug 02 10:24:04.096322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 177/357] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:04.598026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:04.598662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:04.605778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.606421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.607255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.607911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.746651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:04.747320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:04.773205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.773679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.782958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.784973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.928235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:04.940979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8045381b-4ed3-4e3a-8619-e6bbfdc671e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.345138 Aug 02 10:24:04.940979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 181/358] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:04 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:05.067004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:05.079672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:05.087152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:05.087152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-74d4363f-db6e-4704-a58b-7f0b2806ecf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.340605 Aug 02 10:24:05.087152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 178/359] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:05.104707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:05.105324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:05.112917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:05.114088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:05.115140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:05.116105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:05.290971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:05.300246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4e2e5636-4487-4e95-9e98-5e7f94b61f5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.199471 Aug 02 10:24:05.301597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 182/360] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:05.963914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:05.966304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:05.977678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:05.982940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:05.984069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:05.984746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.109271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:06.109933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:06.121723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:06.122173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.125608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:06.127025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.359235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:06.370056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8eea490f-a877-439c-9c63-8b2277429bea tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.409836 Aug 02 10:24:06.385250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 179/361] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:05 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:06.390749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:06.393207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:06.405048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:06.409069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.409567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:06.410236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.424056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:06.434879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:06.437341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:06.439690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6757ec29-bdec-410e-96f1-03a2ed26374d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.337075 Aug 02 10:24:06.440815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 183/362] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:06.693207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:06.703692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78632dc2-91d9-4055-ab65-6e3459f1f63f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.328077 Aug 02 10:24:06.704526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 180/363] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:07.393063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:07.394764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:07.415606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.417940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.419128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.427511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.468579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:07.470859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:07.482622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.484687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.488248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.491637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.829803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:07.839930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:07.845833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:07.847092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5ad8f16d-75a4-40f1-901b-3ff232ff9791 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.384223 Aug 02 10:24:07.848341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 181/364] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:07.853539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:07.854373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:07.860734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.862569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.862569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:07.862569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:07.884750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:07.908233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-90421a5c-6419-4411-99a7-658d5b4bfe2e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.518603 Aug 02 10:24:07.910820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 184/365] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:07 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:08.057685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:08.066203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9c0d6ed-192a-4e9f-b6d7-2c115dfe14c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.216805 Aug 02 10:24:08.067023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 182/366] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:08.870483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:08.871134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:08.873620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:08.878997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:08.879474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:08.880242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:08.880678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:08.929312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:08.930072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:08.936256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:08.936700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:08.937516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:08.937982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:09.126617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:09.148594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c79a7153-ee9c-4576-8f61-53f978a8883a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.223722 Aug 02 10:24:09.149859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 183/367] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:08 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:09.165171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:09.165801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:09.178835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:09.179310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:09.180100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:09.206918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:09.440820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:09.449048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:09.450529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5fb725ca-9f9d-4e00-ad7d-49d4ffe96691 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.299348 Aug 02 10:24:09.451362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 184/368] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:09.471847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:09.471847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:09.471847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0b4a9007-8946-445f-8dbc-4d4aa94ef225 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1748 microversion: 2.20 time: 0.596526 Aug 02 10:24:09.472610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 185/369] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1748 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:10.170315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:10.171781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:10.179223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.179684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.180539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.180907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.377525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:10.405782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-417f332a-9fcd-4edc-a22e-597a91eca476 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.239524 Aug 02 10:24:10.427652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 186/370] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:10 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:10.476869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:10.477515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:10.487730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.487730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.487730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.487730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.494143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:10.494786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:10.502143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.502748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.503574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.504016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.699557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:10.711920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:10.713698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:10.715062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-72c973bf-b076-4513-90f6-f2fd1abdb64e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1750 microversion: 2.20 time: 0.228487 Aug 02 10:24:10.715705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 187/371] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:10.724004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:10.724892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:10.736561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.737045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.737884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:10.738351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:10.760913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:10.770900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:24:10.771291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-798ec45a-db6e-4d0a-a416-f3519c950c3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.298050 Aug 02 10:24:10.772232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 185/372] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:10.808784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:11.192005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-caa95fdf-0441-4f18-a453-6c48b411d096 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 204 len: 0 microversion: 2.1 time: 0.474605 Aug 02 10:24:11.194163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 188/373] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:24:10 2022] DELETE /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:11.201659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:11.202605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:11.212346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.213260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.214649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.216006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.220849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:11.418389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.428584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-636a39ba-e5d8-482f-ba6b-3ad9166a90c7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1513 microversion: 2.1 time: 0.230922 Aug 02 10:24:11.434551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:11.435359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:11.440526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 186/374] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:11 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:11.444241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.445047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.446849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.447320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.632000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.641544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7959bf7-1d20-413f-bbce-b0627a7980a4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.213903 Aug 02 10:24:11.642413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 189/375] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:11 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:11.741573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:11.743082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:11.753860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.754383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.755463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.755997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.794438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:11.795502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:11.803377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.804021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.804817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:11.805249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:11.913259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.922459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.924763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.925979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a4ac74bc-a559-4478-80bc-dd01cce23be8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1750 microversion: 2.20 time: 0.188773 Aug 02 10:24:11.926732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 187/376] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:11.955409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:11.963220 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dbdf4fb5-5492-4ae8-9de6-4d6e600640a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.173312 Aug 02 10:24:11.963860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 190/377] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:12.453258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:12.455554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:12.463076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.466006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.466006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.466006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.663671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:12.667410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:12.671787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.672223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.673054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.673481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.740000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:12.747770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b8e34eb-36a8-46e9-80da-d66decd310b8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1513 microversion: 2.1 time: 0.300244 Aug 02 10:24:12.763435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 188/378] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:12 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:12.817705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:12.826610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-648fecf9-5089-48a9-89e9-2dffff45d75c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1522 microversion: 2.1 time: 0.165917 Aug 02 10:24:12.826610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 191/379] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:12 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:12.952183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:12.953276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:12.961202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.961902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.962414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:12.962859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:12.991294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:12.991817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:13.017436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.017882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:13.018660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.019086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:13.248612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:13.262146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:13.264095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:13.269675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7e1defd6-a966-4100-9d24-b1eeaffb5cac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1750 microversion: 2.20 time: 0.321220 Aug 02 10:24:13.270605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 189/380] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:13.329163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:13.338537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f2e0efea-6cd4-4d88-b2f7-f952b0df02ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.357560 Aug 02 10:24:13.339737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 192/381] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:13.772059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:13.772680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:13.779645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.780095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:13.780935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.781373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:13.852088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:13.852088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:13.863013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.863754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:13.864988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:13.867588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.047566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.055607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fcfc5bec-af48-4ff5-9650-5b71ea1d3227 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1513 microversion: 2.1 time: 0.287979 Aug 02 10:24:14.065048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.069829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 190/382] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:13 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:14.073547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3221c987-69c1-4bcf-847a-f54a91faa2b8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1502 microversion: 2.1 time: 0.229943 Aug 02 10:24:14.074314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 193/383] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:13 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:14.096155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:14.097489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:14.105203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.106015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.107005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.107863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.293977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:14.294780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:14.301691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.302138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.302913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.303379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.453927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.465269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.467498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.468679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d57afd30-1ded-44b8-81a8-6a0e26f2219b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1750 microversion: 2.20 time: 0.178685 Aug 02 10:24:14.470122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 194/384] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:14.475039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:14.476752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:14.483848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.484530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.485996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:14.486588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:14.569407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.579593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80170235-9120-4cd3-a59c-9376d6bdbc8a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1516 microversion: 2.1 time: 0.487569 Aug 02 10:24:14.580168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 191/385] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:14 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:14.706675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:14.717590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c1ff861f-f5dc-41c2-b761-1d40b9a6bf61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.246051 Aug 02 10:24:14.718167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 195/386] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:15.081681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:15.082298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:15.091040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.091968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.092848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.093289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.256217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:15.275376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9f061f3e-9b65-413a-bc3e-9a4442f466e5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1513 microversion: 2.1 time: 0.200001 Aug 02 10:24:15.275376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 192/387] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:15 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:15.501963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:15.503399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:15.513933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.516253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.519002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.519769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.741573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:15.742137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:15.756769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.756769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.756769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:15.756769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:15.849377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:15.858856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:15.862537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:15.864674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee739a55-9556-4d0d-84bf-0cefeaf45354 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1750 microversion: 2.20 time: 0.366728 Aug 02 10:24:15.865511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 196/388] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1750 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:15.920649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:15.940296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93f83d7b-fc9d-4c43-9d88-760e94e80209 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.202652 Aug 02 10:24:15.942283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 193/389] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:16.295522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:16.296331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:16.310843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.311737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.312791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.313560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.416911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-e47d1d6f-7f08-4855-ac7f-7d92016c3f97 req-470d02da-e087-4da3-b6d2-6523a4806ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da1d83c-cb8c-4809-a11b-6987fc2a7a6d", "name": "network-vif-deleted", "tag": "eab2d499-08a8-479f-8c33-048e39479f51"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:16.430354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e47d1d6f-7f08-4855-ac7f-7d92016c3f97 req-470d02da-e087-4da3-b6d2-6523a4806ee9 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.434515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e47d1d6f-7f08-4855-ac7f-7d92016c3f97 req-470d02da-e087-4da3-b6d2-6523a4806ee9 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.444667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-e47d1d6f-7f08-4855-ac7f-7d92016c3f97 req-470d02da-e087-4da3-b6d2-6523a4806ee9 service nova] Creating event network-vif-deleted:eab2d499-08a8-479f-8c33-048e39479f51 for instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d on hv-cinder-84753 Aug 02 10:24:16.452770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:16.453337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-e47d1d6f-7f08-4855-ac7f-7d92016c3f97 req-470d02da-e087-4da3-b6d2-6523a4806ee9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039697 Aug 02 10:24:16.454744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 194/390] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:16.462915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac9de8c6-1cfe-4ebb-9472-3e85c3423329 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1471 microversion: 2.1 time: 0.171170 Aug 02 10:24:16.463527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 197/391] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:16 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:16.572893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:16.575293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:16.582952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.589496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.589496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.589496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.614853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lazy-loading 'flavor' on Instance uuid 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:24:16.889075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:16.889690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:16.897076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.897873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.900233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.900233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.206798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:17.217593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:17.220506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:17.222164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6fd87fc0-e137-44bf-91fb-cb1e22147b8b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.337176 Aug 02 10:24:17.228309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 198/392] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:17.229959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:17.231058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:17.239739 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.240133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.240942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.243794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.245613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e1bbcea-0b6f-4a21-a4ca-17d10a4ae30f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/action" status: 200 len: 32 microversion: 2.1 time: 0.677093 Aug 02 10:24:17.262842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 195/393] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:24:16 2022] POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/action => generated 32 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:24:17.270058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:17.271080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:17.279264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.280261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.281533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.282804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.475906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:17.493903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e5dd559e-06b6-4671-b315-339bb85e343e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.229210 Aug 02 10:24:17.494479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 196/394] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:17 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:17.511921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:17.514462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:17.526797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.537982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.544096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.544096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.607710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:17.608570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:17.609476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'fault' on Instance uuid 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:24:17.672788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:17.681983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-58300a34-6bd5-43a5-979e-6588a9e6e5d9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 200 len: 1308 microversion: 2.1 time: 0.186258 Aug 02 10:24:17.682605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 197/395] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:17 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:18.056560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.069986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ec49953b-ba70-4faf-8b39-15684bbc2576 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.845389 Aug 02 10:24:18.071758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 199/396] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:18.254715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:18.264340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:18.264340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.264340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.266666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.272730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.492706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.502554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.504266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.506009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a6def253-484e-4b2f-b733-60b052bc8103 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.257527 Aug 02 10:24:18.507073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 198/397] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:18.526642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:18.526642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:18.537073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.537523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.538299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.538731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.707740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:18.708450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:18.721044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.724790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.724790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.724790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.749451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d HTTP/1.1 Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:24:18.751527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. Aug 02 10:24:18.753573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '1da1d83c-cb8c-4809-a11b-6987fc2a7a6d'} Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:24:18.754587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. Aug 02 10:24:18.756194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:18.758183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 404 to user: Instance 1da1d83c-cb8c-4809-a11b-6987fc2a7a6d could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:24:18.759392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c1559e4-7400-4b81-b785-ccbcaee0c13a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d" status: 404 len: 111 microversion: 2.1 time: 0.055434 Aug 02 10:24:18.760101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 199/398] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:18 2022] GET /compute/v2.1/servers/1da1d83c-cb8c-4809-a11b-6987fc2a7a6d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:24:18.939036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.961140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4ce6fd7-b28a-4b9b-b439-2f87e14d60c9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.447118 Aug 02 10:24:18.961827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 200/399] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:18 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:19.099098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:19.099829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:19.121556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.138107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:19.139341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.141389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:19.507409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:19.520575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f2a810ee-b986-4d68-8af1-b060e7647630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.431701 Aug 02 10:24:19.522121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 200/400] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:19.540360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:19.541860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:19.563915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.567333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:19.568336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.568931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:19.572109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46811dca-8a8c-4473-90fa-bf4041d7d184 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Action: 'create', calling method: .version_select at 0x7f70c2d244c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2073184305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODLmZOj0B178oQJYYcdigXYyH9kHv3eVhyEv+RSaG9NHfUjwJ2Gwu6pAUhhKlH10iJ+FQqnriLGK7cWgs+lzbwYx49Q1mqgfKYk9P4Qfgjb3oQRGYkw+pVM1HZfPfm4sQ=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:19.603614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-46811dca-8a8c-4473-90fa-bf4041d7d184 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Getting quotas for project 64f73de1986f406182cc6a52b8376b93. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:19.605038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-46811dca-8a8c-4473-90fa-bf4041d7d184 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Getting quotas for user 8d42f70ad3cb4c9388c09a70cfc950dc and project 64f73de1986f406182cc6a52b8376b93. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:19.708521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46811dca-8a8c-4473-90fa-bf4041d7d184 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.491764 Aug 02 10:24:19.712911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 201/401] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:24:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:19.726447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:19.730197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:19.744214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:19.752562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:19.756423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bd831a2d-4425-4fb6-b7c0-fd9d8f3384b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.229335 Aug 02 10:24:19.772602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 201/402] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:19.986541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:19.987142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:19.995245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.995945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.011290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:20.012858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.351483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.366123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7d11314-e720-4189-a7a5-25937701be50 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.383158 Aug 02 10:24:20.366861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 202/403] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:19 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:20.546100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:20.546752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:20.554756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:20.555213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.556024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:20.556507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.710500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.722036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4dabcdb4-9373-4785-bd29-68c566f5ffd0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.179755 Aug 02 10:24:20.745055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 202/404] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:20.780250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:20.780859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:20.788572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:20.788727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.789499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:20.789939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.955206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.965542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.968556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.971940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-21c3e966-e103-470e-a524-ef6294b65e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.195058 Aug 02 10:24:20.973228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 203/405] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:21.390830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:21.392154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:21.417327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.417327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.417327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.417327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.650517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:21.660954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b06b22cd-1277-426e-8fd0-5d73d4651f03 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.275011 Aug 02 10:24:21.662092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 203/406] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:21 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:21.749651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:21.750526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:21.768778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.769617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.771525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.773129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.999859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:22.000761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:22.018674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.025480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:22.025480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.025480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:22.119994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.133934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13cde81c-fbbb-4836-917c-a1eac2c90286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.389781 Aug 02 10:24:22.140873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 204/407] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:22.290573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.304502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.306631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.307753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c056adf9-a7b0-4c6a-bb4e-140e3c513831 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.312486 Aug 02 10:24:22.308315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 204/408] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:22.687275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:22.687968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:22.726785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.726785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:22.726785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.726785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.074565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.078765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:23.089834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ee14e3c-5005-4d28-9715-d1046c98dd56 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.409768 Aug 02 10:24:23.103009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 205/409] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:22 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:23.166273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:23.179056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:23.179056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.179056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.179056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.179461 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.343172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:23.351519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:23.377213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.379023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.382604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.383473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.604757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.643138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4671c593-3362-4073-8869-361ac4073a44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.480940 Aug 02 10:24:23.665216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 205/410] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:23.920271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.934819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.934819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.935830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-05016fa1-b83e-44fc-8656-6eec708f4b76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.603043 Aug 02 10:24:23.937337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 206/411] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:23.986139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-62f98eff-46e4-41d4-b85f-f09454d1d42d req-be26faee-5358-4f8e-a0ae-2645575edbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "name": "network-vif-plugged", "status": "completed", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:24.006304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-62f98eff-46e4-41d4-b85f-f09454d1d42d req-be26faee-5358-4f8e-a0ae-2645575edbfb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.006507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-62f98eff-46e4-41d4-b85f-f09454d1d42d req-be26faee-5358-4f8e-a0ae-2645575edbfb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.028768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-62f98eff-46e4-41d4-b85f-f09454d1d42d req-be26faee-5358-4f8e-a0ae-2645575edbfb service nova] Creating event network-vif-plugged:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:24:24.038261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-62f98eff-46e4-41d4-b85f-f09454d1d42d req-be26faee-5358-4f8e-a0ae-2645575edbfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059957 Aug 02 10:24:24.039728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 206/412] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:24.123919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:24.124741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:24.141127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.143036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.144192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.147947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.408533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:24.419750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-480d9904-6270-4878-ba57-b52f0c5c6f2d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.308764 Aug 02 10:24:24.424770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 207/413] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:24 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:24.697621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:24.700386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:24.708480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.709215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.710580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.711318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.897426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:24.907116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3cb0cdd-0517-458e-9217-cc6fde075859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.220972 Aug 02 10:24:24.920024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 207/414] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:24.961826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:24.962498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:24.988791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.990073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.996182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.996182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.181570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.198457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.200201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.203534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-50ccd30f-54d3-4051-811d-3ac48fd9ca2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.245644 Aug 02 10:24:25.205471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 208/415] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:25.457564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:25.458176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:25.464432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.464875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.465645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.466082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.650770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.659408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-26c768b2-09ef-47ef-9f10-d2f19aba51e6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.205789 Aug 02 10:24:25.660047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 208/416] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:25 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:25.930779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:25.932221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:25.941683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.942416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.943748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.944359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:26.127944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:26.135629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-43ab4aa8-55e0-499f-b761-8eefc3142065 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.209358 Aug 02 10:24:26.136275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 209/417] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:26.258931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:26.260609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:26.273244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:26.273718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:26.278080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:26.278080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:26.475966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:26.486686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:26.488249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:26.489428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-92565b27-46cc-4406-bb37-fb2a925b6618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.236319 Aug 02 10:24:26.490406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 209/418] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:26.685169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:26.689235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:26.693141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:26.693713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:26.694603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:26.695077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:26.889210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:26.897773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8112e009-1bc0-4635-86e0-ff220d9fc853 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.220414 Aug 02 10:24:26.898568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 210/419] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:26 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:27.160795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:27.161756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:27.170062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.171332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.172321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.173295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.392820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.402094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c518abfb-914e-4a86-a074-39d15253254a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.247880 Aug 02 10:24:27.402725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 210/420] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:27.517082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:27.518072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:27.526761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.527649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.528521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.529074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.694824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.703477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.705620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.706769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca744ff0-8d53-49c9-9a96-150368f6888c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.194700 Aug 02 10:24:27.707382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 211/421] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:27.919546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:27.920658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:27.928778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.929595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.930611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.931275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.108794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.116491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-71cc2872-e799-4919-9f09-3be29eb33612 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.200930 Aug 02 10:24:28.117098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 211/422] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:27 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:28.423952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:28.424568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:28.430745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.431270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.431983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.432407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.592818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.611661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be7f40d0-0c13-4e2d-92cd-6a0120e36b42 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.192069 Aug 02 10:24:28.612243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 212/423] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:28.730241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:28.730866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:28.741318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.742327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.743228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.743841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.881329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.890505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.892854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.894208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5105f0a8-6e69-4769-936d-fc5d76f65dbf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.168304 Aug 02 10:24:28.894764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 212/424] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:29.137879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:29.138560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:29.145111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.145561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.146338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.146771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.311775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:29.321032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-45632948-4251-40df-897d-4f8755b445d8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.186870 Aug 02 10:24:29.334954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 213/425] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:29 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:29.636652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:29.637292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:29.643166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.643643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.644392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.644839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.795873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:29.804170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4a525ce1-eb58-4d86-80d5-ac12406d61f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.171307 Aug 02 10:24:29.804740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 213/426] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:29.926277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:29.926902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:29.929276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:29.934179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.934628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.935421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.941254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.068790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.077316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.078838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.080024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c9eb9962-2ab8-405c-b19f-712fa640acfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.158340 Aug 02 10:24:30.080581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 214/427] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:30.342107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:30.342733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:30.349456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.349946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.350701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.351133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.480144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.487799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7fe1f7e2-eeb6-403d-83ed-41284e0353a3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.149619 Aug 02 10:24:30.488354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 214/428] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:30 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:30.825693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:30.826312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:30.831705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-147384335", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "networks": [{"uuid": "53f05d13-0ece-49e6-8287-3ac24c15615d"}]}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:30.832725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.833182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.833996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.834430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.034196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.043511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-421c967f-628d-49bc-87d6-6877509a1613 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.221730 Aug 02 10:24:31.045720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 215/429] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:31.103551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:31.104390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:31.111098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.111799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.112759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.113195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.252458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.261834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.263573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.264838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c235977-6160-403f-a115-cd3dce151cd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.165336 Aug 02 10:24:31.265428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 216/430] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:31.396097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] validate_networks() for [('53f05d13-0ece-49e6-8287-3ac24c15615d', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:24:31.509515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:31.510109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:31.517183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.517628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.518392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.518819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.668511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.678622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-81cfa6e5-ef64-47ac-95d5-28a32206b547 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.172986 Aug 02 10:24:31.679226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 217/431] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:31 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:31.760980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:24:31.761408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:24:31.761884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:24:31.762295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:24:31.762771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:24:31.772146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.772803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.773875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.774472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.792643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Getting quotas for project 356ad325d7914771a7e1b66caf2b6e4d. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:31.796610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Getting quotas for user 1a800d95ac1d492bb44947fdf5bb3377 and project 356ad325d7914771a7e1b66caf2b6e4d. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:31.807987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:24:31.810246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:24:31.977361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d04c0bbc-9b41-430e-aff2-05a15ef0ecc0 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149600 Aug 02 10:24:31.981746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 215/432] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:24:31.990225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-84ce7065-4282-4f82-884f-3c4e404e753d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:31.994071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-84ce7065-4282-4f82-884f-3c4e404e753d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:32.065388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-84ce7065-4282-4f82-884f-3c4e404e753d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.067743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:32.068567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:32.072376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-84ce7065-4282-4f82-884f-3c4e404e753d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1218 microversion: 2.1 time: 0.087070 Aug 02 10:24:32.073143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 218/433] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:31 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:32.076975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.077621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.078620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.079281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.227932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.235971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8ec71497-0f77-4737-9a35-71c2569005ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.171991 Aug 02 10:24:32.236541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 216/434] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:32.293393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:32.293393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:32.303039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.303039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.303039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.303039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.499542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.509569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.511246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.512588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-54d52561-1758-44f6-bbc7-c3cc32e42e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.228640 Aug 02 10:24:32.515229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 219/435] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:32.699843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:32.700494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:32.703712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:32.707824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.711759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.711759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.711759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.843482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:32.858056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81d138f1-0a23-4e2d-ad60-c06f53a22627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.162140 Aug 02 10:24:32.858711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 217/436] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:32 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:33.094752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:33.095751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:33.103107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.103595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.104480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.104936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.167766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.175835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f0e06a5-91a2-45ae-80c9-49aa5d2b8fc6 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1222 microversion: 2.1 time: 0.086110 Aug 02 10:24:33.176465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 220/437] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:33 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:33.258625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:33.259313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:33.265639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.266109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.266860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.267325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.416518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.425796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-64f4e37c-6118-44d2-8f17-6e03ed00a77d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1357 microversion: 2.1 time: 0.171970 Aug 02 10:24:33.426375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 218/438] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:33.538713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:33.539434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:33.545773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.546336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.547217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.547676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.691969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.709803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.711627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.713502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0acda694-7a64-490e-9165-25803cba8c71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.178310 Aug 02 10:24:33.723388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 221/439] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:33.885349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:33.885349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:33.887042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.887522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.888286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:33.888717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.030357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.034403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:34.038700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5ab74f7b-2a0b-4175-ad78-19b0d454b9be tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.163195 Aug 02 10:24:34.039288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 219/440] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:33 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:34.198207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.199219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:34.206423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.206862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.207655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.208081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.275465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.282842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-01e2def1-d2f1-4b96-b8d0-052ec1645708 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1270 microversion: 2.1 time: 0.088702 Aug 02 10:24:34.285604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 222/441] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:34.450180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.450847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:34.458077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.458533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.459350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.459793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.596945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.605051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b240c67-5b39-40fc-99d2-1f9e5a69bb54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1546 microversion: 2.1 time: 0.159626 Aug 02 10:24:34.605918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 220/442] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:34.628068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.628822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:34.635099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.635540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.636390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.636822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.656265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:34.737067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.737723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:34.744475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.744922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.750650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.750650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.785110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.792040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c7ec6f65-ae7c-4de3-8b71-ab0c4dbaca4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1546 microversion: 2.1 time: 0.168649 Aug 02 10:24:34.792634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 223/443] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:34.814909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.819961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.820779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Searching by: {'deleted': False, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c'} {{(pid=118453) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 10:24:34.827645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.828230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.829120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.829648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.904905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.916364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.918070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.919395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18f26b94-f704-4945-8c81-bec2883ed5c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.186835 Aug 02 10:24:34.920343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 221/444] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:34.929547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.multi_cell_list [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 10:24:35.028669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5fc918b6-3cb9-407b-9dde-f2121b93dc7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218824 Aug 02 10:24:35.029232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 224/445] 10.222.0.49 () {58 vars in 1125 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:35.041616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:35.046023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:35.050367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.050821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.051665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.052103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.060131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:35.060746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:35.067330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.067874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.068643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.069072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.199877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.208767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5f7b368-d56e-4582-abc7-5b0eae2ebdee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1546 microversion: 2.1 time: 0.171411 Aug 02 10:24:35.209885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 222/446] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:35.305219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:35.306198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:35.314114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.314857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.316264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.318169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.337290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.344142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-54cd5055-61a5-45e4-96cb-349b4bb64e1a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.287876 Aug 02 10:24:35.347871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 225/447] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:35 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:35.410248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.419578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5dc46aa5-cf09-4d69-9211-7b2d65d16e0e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1278 microversion: 2.1 time: 0.119049 Aug 02 10:24:35.420169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 223/448] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:35 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:35.945802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:35.946423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:35.949504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:35.967020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.974361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.975245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.979455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.207362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.215981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.217523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.218683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-908d0ce2-bd13-4785-aa9d-6c5cdc0b2440 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.278450 Aug 02 10:24:36.219252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 226/449] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:36.367069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:36.367720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:36.374944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.375418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.382491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.382491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.441226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:36.441843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:36.451304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.451754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.453543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.453991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.549807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.557805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d1986096-e0c9-4fb2-9178-f04452054dfb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.194711 Aug 02 10:24:36.558459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 224/450] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:36 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:36.683689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.692266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2c44c8ca-224e-4d46-b178-147ada4b9883 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.255466 Aug 02 10:24:36.692815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 227/451] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:36 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:37.241837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:37.242837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:37.248852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.249348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.250110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.250539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.428034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.437098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.438622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.440766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a575b3c-2e25-4b3b-bc33-d08db2a2039b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.203172 Aug 02 10:24:37.441710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 225/452] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:37.579049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:37.579812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:37.587757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.588315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.588481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-470acb5d-bf8a-4e5f-8707-9990147468ea req-39f6a5aa-855f-426d-945b-ec0ab2beb3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88583914-a127-4108-9fd8-74a4a6707e47", "tag": "a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:37.589267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.589800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.620593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-470acb5d-bf8a-4e5f-8707-9990147468ea req-39f6a5aa-855f-426d-945b-ec0ab2beb3b2 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.621025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-470acb5d-bf8a-4e5f-8707-9990147468ea req-39f6a5aa-855f-426d-945b-ec0ab2beb3b2 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.640062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-470acb5d-bf8a-4e5f-8707-9990147468ea req-39f6a5aa-855f-426d-945b-ec0ab2beb3b2 service nova] Creating event network-changed:a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b for instance 88583914-a127-4108-9fd8-74a4a6707e47 on hv-cinder-84753 Aug 02 10:24:37.648756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-470acb5d-bf8a-4e5f-8707-9990147468ea req-39f6a5aa-855f-426d-945b-ec0ab2beb3b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063735 Aug 02 10:24:37.649546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 226/453] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:37.658169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f85bba9-3845-4547-8013-d364913fd3af"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:37.659164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:37.665985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.666671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.668117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.669247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.783584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.791410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7542d79-92d0-41b6-b8da-2ec31b27ff5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.216251 Aug 02 10:24:37.792302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 228/454] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:37 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:37.811672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:37.812719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:37.827688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.828235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.829023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.829465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.997191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.005115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d55ea15d-7478-4d3f-bebd-ad1f0ed56d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.197726 Aug 02 10:24:38.005690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 229/455] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:37 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:38.464461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:38.465145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:38.472158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.472661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.473453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.473962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.618855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.628002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.629537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.630671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d3ac4c6-c109-4ee9-b0fe-69cebe331841 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.170456 Aug 02 10:24:38.631235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 230/456] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:38.813188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:38.813798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:38.820086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.820530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.821289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.821897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.965052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.978263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed7523dc-8db5-402e-b882-80f2f4881b35 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.168887 Aug 02 10:24:38.978844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 231/457] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:38 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:39.025677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:39.026277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:39.032149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.032588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:39.033860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.034287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:39.174160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:39.181998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4465ce95-2946-4ca0-8e77-a16dc4772435 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.159977 Aug 02 10:24:39.182646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 232/458] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:39 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:39.653270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:39.656928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:39.662313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.662580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:39.663371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.663801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:39.892954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:39.901562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:39.902915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:39.904148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a59cce71-4a3f-4664-85da-08008c94c078 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.254858 Aug 02 10:24:39.920198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 233/459] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:39.961170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-57ebe985-af91-4f7d-978c-48880455dd93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.309944 Aug 02 10:24:39.961984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 227/460] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:24:37 2022] POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 194 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:40.000481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:40.001086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:40.007923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.008365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.009126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.009753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.166008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:40.177188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eac99617-2efd-4d3e-a3e1-4af46d1f4aa7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.180283 Aug 02 10:24:40.177886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 234/461] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:39 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:40.204165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:40.205196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:40.212222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.212883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.214182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.214788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.374553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:40.384818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d91354e1-fe6b-4528-97b1-6ea38aa7c36d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.185153 Aug 02 10:24:40.386345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 228/462] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:40 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:40.929547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:40.930154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:40.936838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.937273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.938231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:40.938658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.077952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.088902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.090577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.091844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-431364e7-390f-427f-a6f5-278f04d0c67d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.167089 Aug 02 10:24:41.092535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 235/463] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:41.198316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:41.198851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:41.205773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.206218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.206982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.207450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.340125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.347729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fa7ca98e-3629-4e84-a389-a3380d671806 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.153415 Aug 02 10:24:41.348338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 229/464] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:41 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:41.405982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:41.406659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:41.413807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.415129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.415288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.415968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.574750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.584388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-74eb5c88-8801-426b-ae3c-c81ff6d8e749 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.182195 Aug 02 10:24:41.585168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 236/465] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:41 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:41.606759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-b1eacbea-d1a0-43ef-b18a-3d87b6be0c82 req-40be2927-f264-44a7-a0c1-ca62c56d1936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "name": "network-vif-plugged", "status": "completed", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:41.619875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b1eacbea-d1a0-43ef-b18a-3d87b6be0c82 req-40be2927-f264-44a7-a0c1-ca62c56d1936 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.620726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b1eacbea-d1a0-43ef-b18a-3d87b6be0c82 req-40be2927-f264-44a7-a0c1-ca62c56d1936 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.634936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-b1eacbea-d1a0-43ef-b18a-3d87b6be0c82 req-40be2927-f264-44a7-a0c1-ca62c56d1936 service nova] Creating event network-vif-plugged:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:24:41.640451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-b1eacbea-d1a0-43ef-b18a-3d87b6be0c82 req-40be2927-f264-44a7-a0c1-ca62c56d1936 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037756 Aug 02 10:24:41.641283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 230/466] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:42.114214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:42.114852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:42.118173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:42.122930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.125380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.125380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.125380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.260224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.269364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.270969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.272264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fcff8458-3f13-4890-859a-f3f2914edae8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.162241 Aug 02 10:24:42.272808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 237/467] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:42.371354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:42.372056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:42.374126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:42.374801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:42.380367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.380816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.381584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.382023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.519100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.537706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7fc5728f-7277-46d6-b638-bf71270a8de6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.160558 Aug 02 10:24:42.537706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 231/468] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:42 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:42.665930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:42.666615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:42.673092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.673542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.674335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.674774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.800509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.807975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b2f9645-e6f9-4da5-b86d-182560017024 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.145947 Aug 02 10:24:42.808536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 238/469] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:42 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:42.943076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1571559858", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:42.994163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] validate_networks() for None {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:24:43.272268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:24:43.272710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:24:43.273179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:24:43.273580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:24:43.274081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:24:43.284108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.284547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.285341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.285791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.297026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:43.299179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.303432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Getting quotas for project c8fc70abe3344813a5c0b831b68f7c71. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:43.305893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.306416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.307359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Getting quotas for user e7f1b0932111477caa21cd18270cd8c5 and project c8fc70abe3344813a5c0b831b68f7c71. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:43.307501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.307915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.318569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:24:43.320963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:24:43.475082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1cafe708-c358-4e27-bc29-17c1f894806c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536581 Aug 02 10:24:43.475780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 232/470] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:24:43.483246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.485614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:43.487539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-84bb6318-d521-485d-a0ff-8d311812745d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:43.488340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-84bb6318-d521-485d-a0ff-8d311812745d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.500041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.503558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.507032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-43abd421-9fac-41e2-b4aa-d87788f516ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.214873 Aug 02 10:24:43.508748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 239/471] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:43.549839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:43.550731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.558440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.560496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.566782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.566782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.597220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-84bb6318-d521-485d-a0ff-8d311812745d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.604887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-84bb6318-d521-485d-a0ff-8d311812745d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1215 microversion: 2.1 time: 0.121760 Aug 02 10:24:43.606047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 233/472] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:43 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:43.727616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.736406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f9b65542-0813-4bb3-9fa6-14877b80944b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1502 microversion: 2.1 time: 0.190397 Aug 02 10:24:43.737020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 240/473] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:43 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:43.758084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8b24c9c-cf3c-42cc-9e8c-0befce6fc51a"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:43.760971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.767374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.767833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.768771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.769290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.794790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] HTTP exception thrown: Cannot 'attach_volume' instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 while it is in vm_state rescued Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Request method failure captured: Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/os-volume_attachments HTTP/1.1 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 74 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6Pr-YuSV8EmiarMytCsYIQw9s-ZwZjpts3cJApP1ExVa1cVMs-RDQACke3bDKaptR--W5K--o6ogrOk6WIaYLqWZodgRsnnw-J816cH_ABwXpjKxgYJXltwbxOjH9qez0OX_orOCdtHKxlkK5TO5sOyvuD7wtToRVUkL1UKttKui9TA Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:24:43.796528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fe6c2dfb82174a5692a746ea51769a94", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 9e50546af342492b9b6f6127b0ce2c61 Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {"volumeAttachment": {"volumeId": "f8b24c9c-cf3c-42cc-9e8c-0befce6fc51a"}} Aug 02 10:24:43.801712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Cannot 'attach_volume' instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 while it is in vm_state rescued Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '8b8132ed-8e07-4258-b20b-a0dbcb53bd48', 'body': {'volumeAttachment': {'volumeId': 'f8b24c9c-cf3c-42cc-9e8c-0befce6fc51a'}}} Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:24:43.802622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 while it is in vm_state rescued Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:43.804003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 while it is in vm_state rescued Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Returning 409 to user: Cannot 'attach_volume' instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 while it is in vm_state rescued {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5270f72-ef4f-42a6-8994-88607a6f5f02 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044020 Aug 02 10:24:43.805374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 234/474] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:24:43 2022] POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 10:24:43.808219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:43.808760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.815664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.816107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.816959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.817318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.828925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:43.830311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.838162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.841781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.841781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.841781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.972459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.979972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-750a8398-948c-49f6-bd99-5141b26d34af tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.154847 Aug 02 10:24:43.980460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 235/475] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:43 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:44.097578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3ffa759a-b400-4c4a-b63c-ba4e56857c4d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/action" status: 202 len: 0 microversion: 2.1 time: 0.293771 Aug 02 10:24:44.098204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 241/476] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:24:43 2022] POST /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:24:44.106467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.107171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.114169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.114618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.115683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.116129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.244297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.251979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83c26c0c-2ca6-48e4-b406-1ea9ce6ec281 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1510 microversion: 2.1 time: 0.149378 Aug 02 10:24:44.252541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 236/477] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:44.533611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.534166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.541856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.545448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.545448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.545448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.628782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0e9302e2-8252-40a4-92db-1cb9202ec909 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.629400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0e9302e2-8252-40a4-92db-1cb9202ec909 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.682360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.698079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.700162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.700324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0e9302e2-8252-40a4-92db-1cb9202ec909 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.701750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e5af973-411e-451f-a083-9e5012ebc072 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.173814 Aug 02 10:24:44.702528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 242/478] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:44.712955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0e9302e2-8252-40a4-92db-1cb9202ec909 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1215 microversion: 2.1 time: 0.088518 Aug 02 10:24:44.713737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 237/479] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:45.000623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:45.001320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:45.003998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:45.008934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.009379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.012233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.012233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.143425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.151068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13b18d79-f8b4-4303-b605-c41e6be741aa tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.154409 Aug 02 10:24:45.151660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 243/480] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:45.273353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:45.273965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:45.280428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.280880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.281648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.282087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.408854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.416787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-018a7352-676a-47af-90c7-bfc5638ad01c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1510 microversion: 2.1 time: 0.147360 Aug 02 10:24:45.417352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 238/481] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:45 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:45.728621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:45.730167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:45.742152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:45.744065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:45.756993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.758055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.759673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.759673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.761221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.762064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.762816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.763358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.808585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:45.881766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.892861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-52f2d31b-07e8-481d-ab95-937810e62f1a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1219 microversion: 2.1 time: 0.154670 Aug 02 10:24:45.893650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 239/482] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:45 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:45.912065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-47c570da-3465-4478-9b3d-e0172f003af7 req-8bf6ecc9-165a-42da-98e3-8b20752456de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88583914-a127-4108-9fd8-74a4a6707e47", "name": "network-vif-plugged", "status": "completed", "tag": "a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:45.926887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-47c570da-3465-4478-9b3d-e0172f003af7 req-8bf6ecc9-165a-42da-98e3-8b20752456de service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.927607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-47c570da-3465-4478-9b3d-e0172f003af7 req-8bf6ecc9-165a-42da-98e3-8b20752456de service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.943216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-47c570da-3465-4478-9b3d-e0172f003af7 req-8bf6ecc9-165a-42da-98e3-8b20752456de service nova] Creating event network-vif-plugged:a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b for instance 88583914-a127-4108-9fd8-74a4a6707e47 on hv-cinder-84753 Aug 02 10:24:45.949261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-47c570da-3465-4478-9b3d-e0172f003af7 req-8bf6ecc9-165a-42da-98e3-8b20752456de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041483 Aug 02 10:24:45.950339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 240/483] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:46.025279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.036901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.038583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.039855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7356a082-1455-4837-8d9c-e158f3dfad09 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.317340 Aug 02 10:24:46.040560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 244/484] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:46.173085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:46.173714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:46.180299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.180758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.181510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.181995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.321677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.329496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ec00a76c-ceff-4043-9a27-ff94157f2071 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.161093 Aug 02 10:24:46.331388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 241/485] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:46 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:46.438381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:46.438925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:46.445425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.445865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.446625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.447057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.591203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.599027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b0412eea-2f48-41de-b1b2-b907d75f5bbd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1510 microversion: 2.1 time: 0.164653 Aug 02 10:24:46.599674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 245/486] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:46 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:46.914775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:46.915680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:46.922787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.923270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.925154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.925790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.988821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.996649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7a0ac62b-f44d-4e7e-9e54-e7da4cc7769b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1267 microversion: 2.1 time: 0.086135 Aug 02 10:24:46.997202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 242/487] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:46 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:47.062961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:47.063643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:47.070427 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.070897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.071886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.072328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.207530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.216924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.218738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.220182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e6ea7ca0-942d-4a88-a803-e38a8f9b969f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.161324 Aug 02 10:24:47.225872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 246/488] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:47.352387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:47.353103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:47.359317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.359879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.360628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.361746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.489306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.496950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a5e90ae9-0e32-4c95-8e1e-831bef4cd2e2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.148393 Aug 02 10:24:47.497507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 243/489] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:47 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:47.620997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:47.621523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:47.628374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.628823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.629584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.630099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.760115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.768064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b861eea9-1a6b-41d8-9fbe-7b19290682a8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1510 microversion: 2.1 time: 0.150417 Aug 02 10:24:47.768624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 247/490] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:47 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:48.018341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.018959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.025482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.025932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.026706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.027143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.091846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.099937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f7bdbf8d-ee69-42f8-8efd-d9fc2721091c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1267 microversion: 2.1 time: 0.086159 Aug 02 10:24:48.100511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 244/491] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:48.244312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.244864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.251439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.251882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.253246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.253676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.381088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.389449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.390946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.392121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25c23b4e-90fb-4fe9-a294-58dc7dbab106 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1806 microversion: 2.20 time: 0.152151 Aug 02 10:24:48.392674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 248/492] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:48.518073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.518686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.524738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.525188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.526001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.526435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.661520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.668810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3ee0dc7e-80d1-4a30-abcb-d1ee93b31a71 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.154782 Aug 02 10:24:48.669357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 245/493] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:48.789449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.789970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.795954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.796396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.797145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.797573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.863844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1898904473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2073184305", "security_groups": [{"name": "tempest-secgroup-smoke-683168206"}], "networks": [{"uuid": "7631dbc2-95bf-4146-8f87-b3e76aee1c44"}], "block_device_mapping_v2": [{"uuid": "52709250-7732-4f42-ba5d-864c8848a565", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:48.937647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.950330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d83f227-b89e-4a46-9345-3cf2d2644ce1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1510 microversion: 2.1 time: 0.164660 Aug 02 10:24:48.958368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 249/494] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:48.990993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] validate_networks() for [('7631dbc2-95bf-4146-8f87-b3e76aee1c44', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:24:49.123783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.127760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.131594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.132042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.132814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.133433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.204416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:49.212914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dfd9c80a-03e6-4788-9d3d-c5a3c6e1f0eb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1267 microversion: 2.1 time: 0.094728 Aug 02 10:24:49.213630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 250/495] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:49.367729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:24:49.368248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:24:49.368649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:24:49.369061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:24:49.369474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:24:49.378365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.378818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.379645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.380080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.396683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Getting quotas for project 64f73de1986f406182cc6a52b8376b93. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:49.400674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Getting quotas for user 8d42f70ad3cb4c9388c09a70cfc950dc and project 64f73de1986f406182cc6a52b8376b93. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:49.415793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.416428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.423113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.423487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.424888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.425317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.459813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:24:49.461895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52709250-7732-4f42-ba5d-864c8848a565',volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:24:49.555567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:49.564361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:49.565914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:49.567096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c881317-17b0-4f3b-81ca-a9f8a280d245 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1793 microversion: 2.20 time: 0.155236 Aug 02 10:24:49.567725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 251/496] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1793 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:49.690221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.690749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.697114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.697895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.698665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.699152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.843481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:49.851922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-904e222b-6150-48d8-b0ee-327e1260ca7d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1318 microversion: 2.1 time: 0.165688 Aug 02 10:24:49.852450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 252/497] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:49.969812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97612fe1-b053-411e-82c5-9f8b96c9f6c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110290 Aug 02 10:24:49.970374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 246/498] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:24:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:24:49.977893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.978551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.981220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-deb66e20-e12b-43f4-939a-8ae4995c8e8f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.981919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-deb66e20-e12b-43f4-939a-8ae4995c8e8f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.984873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.986021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.986924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.987604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.039642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-deb66e20-e12b-43f4-939a-8ae4995c8e8f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.050046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-deb66e20-e12b-43f4-939a-8ae4995c8e8f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1089 microversion: 2.1 time: 0.072212 Aug 02 10:24:50.058452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 247/499] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:50.133571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.141030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-773566d1-c0f1-426d-bdb6-2fe1d1ad51e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1516 microversion: 2.1 time: 0.167053 Aug 02 10:24:50.141583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 253/500] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:50.234350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:50.234979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:50.242951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:50.243452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.244237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:50.244675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.310229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.318625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a0baefa3-74b6-401c-b407-26d1abce30bd tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1275 microversion: 2.1 time: 0.088499 Aug 02 10:24:50.322297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 248/501] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:50 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:50.874496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:50.875238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:50.882845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:50.887324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.887324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:50.887324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.047492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.055644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4cabe36f-c86a-4c1e-9e1b-9b08959f00f7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1507 microversion: 2.1 time: 0.185934 Aug 02 10:24:51.056203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 254/502] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:50 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:51.073266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90061510-ac71-4c4e-a929-43421fbe3728 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:51.073879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-90061510-ac71-4c4e-a929-43421fbe3728 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.076647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89f9129b-1383-45ca-a98c-8dfae942d3cb", "device": "/dev/sdb"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:51.077380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:51.079287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.097989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.098424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.099213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.099671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.119306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:51.140085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-90061510-ac71-4c4e-a929-43421fbe3728 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.147374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-90061510-ac71-4c4e-a929-43421fbe3728 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1089 microversion: 2.1 time: 0.077828 Aug 02 10:24:51.155802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 249/503] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:51.340961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:51.342825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.350936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.351570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.352330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.352765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.414996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.422448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-614d93f7-b848-4e33-921f-b3caad7eeb24 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1285 microversion: 2.1 time: 0.085859 Aug 02 10:24:51.423000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 250/504] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:51 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:51.780500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:51.780998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.788042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.788533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.789428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.789871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.814884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c00e203-bc6d-473a-ba62-7732d4d4f9f4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/ips" status: 200 len: 150 microversion: 2.1 time: 0.038440 Aug 02 10:24:51.815900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 251/505] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:24:51 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:51.831265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6c3012-f7be-4b88-a45f-889e5d601451"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:51.833893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.848999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.851738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.851738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.851738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.941566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: POST /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/os-volume_attachments HTTP/1.1 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 74 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:24:51.943372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {"volumeAttachment": {"volumeId": "dc6c3012-f7be-4b88-a45f-889e5d601451"}} Aug 02 10:24:51.949537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': 'da557b6b-b710-411d-94ef-d1d2a2bde8cc', 'body': {'volumeAttachment': {'volumeId': 'dc6c3012-f7be-4b88-a45f-889e5d601451'}}} Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:51.950427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:51.951841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 400 to user: Invalid volume: volume dc6c3012-f7be-4b88-a45f-889e5d601451 is already attached to instances: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9681d064-fb98-41ce-b11e-675109a5cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120609 Aug 02 10:24:51.953205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 252/506] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:24:51 2022] POST /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:24:51.953791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99ec52fd-0064-405e-abd9-a3a7dc22fa00 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: .version_select at 0x7f70c3342a60>, body: {"keypair": {"name": "tempest-keypair-813696852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI/Y1wEIPc70XwS8CjnDdNQHgSJKVGc1eKGuvRpwKDyNgmGbcWp8FKWZFuncu12HHLZc6x+x+HeUxVOVJukfsEp+rW33pb0XKAuX7uDawYk1iZ1VOTlzIh8wH6Bthvy8g=="}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:51.972577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-99ec52fd-0064-405e-abd9-a3a7dc22fa00 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for project fe6c2dfb82174a5692a746ea51769a94. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:51.976774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-99ec52fd-0064-405e-abd9-a3a7dc22fa00 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for user 9e50546af342492b9b6f6127b0ce2c61 and project fe6c2dfb82174a5692a746ea51769a94. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:52.078420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99ec52fd-0064-405e-abd9-a3a7dc22fa00 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131558 Aug 02 10:24:52.079023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 253/507] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:24:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:52.084097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:52.084610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:52.091860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.092307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.093078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.093520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.123752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:24:52.620614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c7a289ee-986b-422b-a40b-7c50b401c7f7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 204 len: 0 microversion: 2.1 time: 0.530132 Aug 02 10:24:52.620614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 254/508] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:24:52 2022] DELETE /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:52.620614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:52.620614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:52.625934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.627273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.628872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.629572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.720403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:52.728318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56457fa2-fe53-4b9d-934f-fe22328eae4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1131 microversion: 2.1 time: 0.114446 Aug 02 10:24:52.728886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 255/509] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1131 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:52.733726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:52.734340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:52.741151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.741595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.742414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.742895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.808383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:52.816822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-16abcc05-56fd-45c0-84cb-7196818483f6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1273 microversion: 2.1 time: 0.086770 Aug 02 10:24:52.821385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 256/510] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:52 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:52.821900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:52.822505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:52.831256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.831630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.832491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.832984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.910543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-66bf3a83-be22-401a-b351-0a9f07fa8026 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "POST /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.837548 Aug 02 10:24:52.911409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 255/511] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:24:51 2022] POST /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments => generated 194 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:52.999717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:53.009721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8683ca1b-14e7-4e27-aff7-86bdd9ebaa49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1681 microversion: 2.1 time: 0.191241 Aug 02 10:24:53.010299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 257/512] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:52 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:53.415397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:53.416093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:53.422346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.422704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.423506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.423924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.560542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:53.570580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1fc08f7e-7f77-44c9-aa05-0b294b78238f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1592 microversion: 2.1 time: 0.159921 Aug 02 10:24:53.571179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 256/513] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1592 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:53.757975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:53.761927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:53.779906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.780422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.781264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.781703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.839451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:53.840249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:53.847507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.849092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.850116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.850807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.983399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.014924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c7e9e5d-6556-4515-9a98-11c53785ec74 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1187 microversion: 2.1 time: 0.267529 Aug 02 10:24:54.016112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 258/514] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1187 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:54.040736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:54.040736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:54.048193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:54.049116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:54.050172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:54.050868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:54.077849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:54.078845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.094837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-988a913e-0b4b-4c6c-855e-19acf2a1c5b4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.260289 Aug 02 10:24:54.095438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 257/515] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:53 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:54.308282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.316556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83951e5c-1ad6-40ef-977b-aac6d2684694 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1681 microversion: 2.1 time: 0.286072 Aug 02 10:24:54.317124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 259/516] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:54 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:54.993839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-606022102", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b48ca37-69cf-48d5-96ff-4dba63259b29"}], "security_groups": [{"name": "tempest-securitygroup--741461772"}], "key_name": "tempest-keypair-813696852", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:55.044098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:55.044718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.062032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.062767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.067613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.067613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.137568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.145018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b38ac620-3d68-47d7-8962-f296d69b4c03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1195 microversion: 2.1 time: 0.112304 Aug 02 10:24:55.145566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 260/517] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1195 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:55.152387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:55.153075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.162732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.163294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.164212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.164753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.314638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.321983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9b723100-0665-4ea6-af9d-87696c37f2de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.175303 Aug 02 10:24:55.322541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 261/518] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:55 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:55.338995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:55.339638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.346972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.347459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.348339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.348789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.354336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] validate_networks() for [('6b48ca37-69cf-48d5-96ff-4dba63259b29', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:24:55.488571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.496512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c9a085c-7413-44b0-811e-b77ffe6f19be tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1681 microversion: 2.1 time: 0.162469 Aug 02 10:24:55.497507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 262/519] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:55 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:56.165951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:56.166592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:56.173863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.174309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.175083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.175546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.256782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.265963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2cf8bc5-cd8e-4cab-a173-8336e7533711 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1205 microversion: 2.1 time: 0.103877 Aug 02 10:24:56.266542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 263/520] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:56.271826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-17ed0483-6680-492a-9f37-fa279cf027f3 req-ed56e200-d851-4d85-99c3-905887cd23e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b253c788-4268-4547-9ab9-94a8e9a15d8e", "tag": "09499b65-57d7-4907-b4cf-fb8436b1e8a3"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:56.282337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-17ed0483-6680-492a-9f37-fa279cf027f3 req-ed56e200-d851-4d85-99c3-905887cd23e0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.282904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-17ed0483-6680-492a-9f37-fa279cf027f3 req-ed56e200-d851-4d85-99c3-905887cd23e0 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.294822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-17ed0483-6680-492a-9f37-fa279cf027f3 req-ed56e200-d851-4d85-99c3-905887cd23e0 service nova] Creating event network-changed:09499b65-57d7-4907-b4cf-fb8436b1e8a3 for instance b253c788-4268-4547-9ab9-94a8e9a15d8e on hv-cinder-84753 Aug 02 10:24:56.300407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-17ed0483-6680-492a-9f37-fa279cf027f3 req-ed56e200-d851-4d85-99c3-905887cd23e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032618 Aug 02 10:24:56.301057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 264/521] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:56.346000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:56.346860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:56.353282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.353828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.354705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.355380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.491906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.499737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf84a1f6-6905-43f8-9ac0-ebaa09e36667 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.159865 Aug 02 10:24:56.500504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 265/522] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:56 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:56.519113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:56.519923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:56.526046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.526513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.527279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.527716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.663562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.671133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8848bdfd-049c-4694-9398-3e7adb16ab81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1681 microversion: 2.1 time: 0.155907 Aug 02 10:24:56.672193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 266/523] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:56 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:57.154120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:24:57.154858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:24:57.155422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:24:57.155816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:24:57.156231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:24:57.166601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.167050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.167893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.168327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.188317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:24:57.192676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Getting quotas for user 9e50546af342492b9b6f6127b0ce2c61 and project fe6c2dfb82174a5692a746ea51769a94. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:24:57.203917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:24:57.206749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:24:57.288822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.290395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.307024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.307024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.307024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.307024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.375499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.390343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fbd79129-5533-420f-9171-d688a5199aad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1205 microversion: 2.1 time: 0.105000 Aug 02 10:24:57.391299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 267/524] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1205 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:57.406971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34fb5745-08d7-4149-8801-e228651e8117 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.417689 Aug 02 10:24:57.408206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 258/525] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:24:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:24:57.422195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a35dc2e1-9fac-4dc1-b4f4-847f2f26e317 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.423475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a35dc2e1-9fac-4dc1-b4f4-847f2f26e317 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.483551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a35dc2e1-9fac-4dc1-b4f4-847f2f26e317 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.492505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a35dc2e1-9fac-4dc1-b4f4-847f2f26e317 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1244 microversion: 2.1 time: 0.076150 Aug 02 10:24:57.493582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 268/526] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1244 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:57.525145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.528365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.543502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.548577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.548577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.548577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.696776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.696776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.700240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.700856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.701793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.702238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.782876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.789047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ebce91f1-e1fd-4efb-b515-448334dbc88d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1615 microversion: 2.1 time: 0.100329 Aug 02 10:24:57.789633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 269/527] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:58.236815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.245036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2aaf48af-aea4-4fbe-90b8-eaec63a064de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.725928 Aug 02 10:24:58.245770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 259/528] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:58.414048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:58.415508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:58.426268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.426722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.428060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.428587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.468597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0cb2cc88-c559-487a-8ee1-c8e43e9f5664 req-63d9752d-839b-4f62-9fce-a2bc30f04e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da557b6b-b710-411d-94ef-d1d2a2bde8cc", "name": "network-vif-deleted", "tag": "7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:58.500186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0cb2cc88-c559-487a-8ee1-c8e43e9f5664 req-63d9752d-839b-4f62-9fce-a2bc30f04e1d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.504601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0cb2cc88-c559-487a-8ee1-c8e43e9f5664 req-63d9752d-839b-4f62-9fce-a2bc30f04e1d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.546156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0cb2cc88-c559-487a-8ee1-c8e43e9f5664 req-63d9752d-839b-4f62-9fce-a2bc30f04e1d service nova] Creating event network-vif-deleted:7d8fe9dd-3d20-4e9c-9ce4-3c82372b4f4f for instance da557b6b-b710-411d-94ef-d1d2a2bde8cc on hv-cinder-84753 Aug 02 10:24:58.554398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0cb2cc88-c559-487a-8ee1-c8e43e9f5664 req-63d9752d-839b-4f62-9fce-a2bc30f04e1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089828 Aug 02 10:24:58.557551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 260/529] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:58.565323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:58.566519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:58.581333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.581333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.581333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.581333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.696914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.707482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-96a6a6bf-6a62-404f-b7c9-2c6c1a2a698e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.297417 Aug 02 10:24:58.708623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 270/530] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:58.746664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.764016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7d78d95-3662-48f6-b7d7-c1c66e567b7b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1248 microversion: 2.1 time: 0.204761 Aug 02 10:24:58.765917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 261/531] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:58 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1248 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:58.813170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:58.813887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:58.825148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.825599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.826390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.826831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.919298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.928435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a14d3699-f187-4e3b-88ed-671ab0137649 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1615 microversion: 2.1 time: 0.120761 Aug 02 10:24:58.929797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 271/532] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:58 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1615 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:59.268919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:59.282551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:59.282551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.282551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.282551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.283269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.712883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:59.722698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-551df2be-11fc-4300-8580-8a011c5752d8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.459122 Aug 02 10:24:59.737094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:59.737094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:59.737094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:59.739413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 262/533] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:59 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:59.742047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.743297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.744711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.746486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.792447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:59.793181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:59.812144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.819122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.820304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.823136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.045910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.054977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b73f0e82-30ca-4d33-8d85-f2a4981640b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1296 microversion: 2.1 time: 0.267482 Aug 02 10:25:00.055596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 263/534] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:59 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:00.086453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:00.089742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:00.107130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.108029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.110019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.113877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.137282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.148399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e7ef1cd1-357a-449e-b7f8-197a783dd63b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.421431 Aug 02 10:25:00.169917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 272/535] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:59 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:00.236123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.237646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.238337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lazy-loading 'fault' on Instance uuid da557b6b-b710-411d-94ef-d1d2a2bde8cc {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:00.370162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.381024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac461d85-6e42-4cc1-8002-5c0b875c5d2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 200 len: 1332 microversion: 2.1 time: 0.304871 Aug 02 10:25:00.381874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 264/536] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:00 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 1332 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:00.600771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-29bb3906-4abc-44fa-bed7-6a69635b1749 req-8296c191-b78f-4205-93b7-e0ed74d074ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:00.630704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-29bb3906-4abc-44fa-bed7-6a69635b1749 req-8296c191-b78f-4205-93b7-e0ed74d074ff service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.633227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-29bb3906-4abc-44fa-bed7-6a69635b1749 req-8296c191-b78f-4205-93b7-e0ed74d074ff service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.662415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-29bb3906-4abc-44fa-bed7-6a69635b1749 req-8296c191-b78f-4205-93b7-e0ed74d074ff service nova] Creating event network-changed:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:25:00.672844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-29bb3906-4abc-44fa-bed7-6a69635b1749 req-8296c191-b78f-4205-93b7-e0ed74d074ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077377 Aug 02 10:25:00.674432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 273/537] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:00.744133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:00.745016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:00.752035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.753010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.753789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.754283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.043953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.053237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7efe4c4e-1500-416a-935d-cc7ad82806a6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.313502 Aug 02 10:25:01.059066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 265/538] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:00 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:01.082514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:01.083233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:01.090505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.091325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.092111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.092545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.162981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.174799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:01.175444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:01.182413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.182746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.184640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-275bdd55-26ad-4a47-8907-35d3ffe26fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1304 microversion: 2.1 time: 0.106296 Aug 02 10:25:01.197804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.198238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 274/539] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:01 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:01.198398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.406587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:01.407856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:01.422017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.422965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.423996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.425205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.448144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc HTTP/1.1 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:25:01.458563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:25:01.459887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'da557b6b-b710-411d-94ef-d1d2a2bde8cc'} Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:01.460623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:25:01.461872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:25:01.464910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:01.464910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c06cd3b3-ff35-49ad-b406-b7f1dd7a98f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 404 len: 111 microversion: 2.1 time: 0.058280 Aug 02 10:25:01.464910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 275/540] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:01 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:25:01.476281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9704c143-8189-45c5-ac46-10a4052323c0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '.version_select at 0x7f70c2b2f0d0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:01.515294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.523502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03669142-7a71-47c5-ad11-252e146ebf3d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.353119 Aug 02 10:25:01.524066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 266/541] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:01.575652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9704c143-8189-45c5-ac46-10a4052323c0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075928723" status: 202 len: 0 microversion: 2.1 time: 0.103106 Aug 02 10:25:01.576236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 276/542] 10.222.0.49 () {58 vars in 1221 bytes} [Tue Aug 2 10:25:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075928723 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:01.900692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-94dae8f8-2bfc-4943-b395-2a4a93c3d6c5 req-3795fd38-5e96-4693-9130-42438ff91a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b253c788-4268-4547-9ab9-94a8e9a15d8e", "name": "network-vif-plugged", "status": "completed", "tag": "09499b65-57d7-4907-b4cf-fb8436b1e8a3"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:01.911962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:01.921356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-94dae8f8-2bfc-4943-b395-2a4a93c3d6c5 req-3795fd38-5e96-4693-9130-42438ff91a5b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.922658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-94dae8f8-2bfc-4943-b395-2a4a93c3d6c5 req-3795fd38-5e96-4693-9130-42438ff91a5b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.935820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-94dae8f8-2bfc-4943-b395-2a4a93c3d6c5 req-3795fd38-5e96-4693-9130-42438ff91a5b service nova] Creating event network-vif-plugged:09499b65-57d7-4907-b4cf-fb8436b1e8a3 for instance b253c788-4268-4547-9ab9-94a8e9a15d8e on hv-cinder-84753 Aug 02 10:25:01.941828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-94dae8f8-2bfc-4943-b395-2a4a93c3d6c5 req-3795fd38-5e96-4693-9130-42438ff91a5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049163 Aug 02 10:25:01.943083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 267/543] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:02.075557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:02.076349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:02.084391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.085669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.086868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.088014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.207169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:02.208354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:02.231383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.235226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.235226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.235226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.311032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.319854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a498b567-ed5c-4314-91a3-bf9790d3c23b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.248855 Aug 02 10:25:02.320594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 277/544] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:02 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:02.547250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:02.552181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:02.561251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.562016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.562997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.563651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.608901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.617274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c21b125b-49e5-4ea8-a7d9-a06052ff08bf tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1302 microversion: 2.1 time: 0.414897 Aug 02 10:25:02.617844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 268/545] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:02 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1302 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:02.738062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-9e6b248f-3ab0-435e-8038-359234c2ca2f req-e7c0e26f-0083-47cb-9a77-b173d901784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:02.761580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9e6b248f-3ab0-435e-8038-359234c2ca2f req-e7c0e26f-0083-47cb-9a77-b173d901784f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.770708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9e6b248f-3ab0-435e-8038-359234c2ca2f req-e7c0e26f-0083-47cb-9a77-b173d901784f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.771178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.775949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-9e6b248f-3ab0-435e-8038-359234c2ca2f req-e7c0e26f-0083-47cb-9a77-b173d901784f service nova] Creating event network-changed:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:25:02.780913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-9e6b248f-3ab0-435e-8038-359234c2ca2f req-e7c0e26f-0083-47cb-9a77-b173d901784f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054881 Aug 02 10:25:02.781592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 269/546] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:02.789189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6e3e80e-73f1-4344-9179-5e778521aee2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.246846 Aug 02 10:25:02.789835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 278/547] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:03.343527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:03.344857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:03.361685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.362211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.363069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.363605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.643584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:03.644354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:03.663442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.663442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.663442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.663442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.663929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:03.673164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a301d22b-5151-4d4d-b7e3-9c0a1eaeb1d2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.335218 Aug 02 10:25:03.673730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 270/548] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:03 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:03.682546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:03.683288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:03.690796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.691605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.692560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.693047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.750347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:03.754865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:03.760912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-835172e5-e30c-48e9-b663-f9ae369ea94b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1302 microversion: 2.1 time: 0.122221 Aug 02 10:25:03.762395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 279/549] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:03 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:03.818632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:03.819619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:03.831612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.837206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.838224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.840860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.872472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lazy-loading 'services' on Instance uuid fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:04.041760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:04.051159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7221ff26-f7e2-4f21-b38a-2d474f791621 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.243063 Aug 02 10:25:04.052357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 280/550] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:04.173557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1045f23b-be3a-4b7a-959c-3b987e995d2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments/dc6c3012-f7be-4b88-a45f-889e5d601451" status: 202 len: 0 microversion: 2.1 time: 0.495943 Aug 02 10:25:04.174482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 271/551] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:25:03 2022] DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments/dc6c3012-f7be-4b88-a45f-889e5d601451 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:04.183893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:04.188658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:04.197616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.198143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.199036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.199630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.241712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-16ede319-55b8-43dc-a713-e150a78cc121 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062344 Aug 02 10:25:04.242567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 281/552] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:04.450265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-113218328"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:04.450897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:04.458186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.458691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.459717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.460355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.474996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:04.595501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.network.security_group_api [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Adding security group 17415122-eab8-4615-9e16-8a53299f7947 to port c4f3f335-8942-45b4-8620-77369a2b71e5 Aug 02 10:25:04.694550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:04.697679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:04.702306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.702749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.703615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.704042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.844070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:04.851463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a15bb707-2487-4725-87f6-029ffcee35b9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.161420 Aug 02 10:25:04.852031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 282/553] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:04 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:04.856493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:04.857365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:04.867924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.868645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.869431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.869860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.000964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0775263f-91ab-4a73-8bbc-11beaccf77f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action" status: 202 len: 0 microversion: 2.1 time: 0.556467 Aug 02 10:25:05.001726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 272/554] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:25:04 2022] POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:05.008149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:05.009722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:05.010623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:05.016038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f007fb25-694f-4a9a-b709-d0d544d891bc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.162952 Aug 02 10:25:05.016824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 283/555] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:04 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:05.016986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.017755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.018570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.019161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.037367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-e4d38faf-b3ca-4ddf-b10f-e5d64f237450 req-fdd6ecd1-a912-4798-b16a-11473bc8889d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:05.050163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e4d38faf-b3ca-4ddf-b10f-e5d64f237450 req-fdd6ecd1-a912-4798-b16a-11473bc8889d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.050612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-e4d38faf-b3ca-4ddf-b10f-e5d64f237450 req-fdd6ecd1-a912-4798-b16a-11473bc8889d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.062690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-e4d38faf-b3ca-4ddf-b10f-e5d64f237450 req-fdd6ecd1-a912-4798-b16a-11473bc8889d service nova] Creating event network-changed:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:25:05.069940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-e4d38faf-b3ca-4ddf-b10f-e5d64f237450 req-fdd6ecd1-a912-4798-b16a-11473bc8889d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037009 Aug 02 10:25:05.069940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 284/556] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:05.074317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:05.075075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:05.081550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.081996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.082766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.083215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.182923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:05.192374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8b80b89b-62c6-44bf-8877-f8c81d550216 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1638 microversion: 2.1 time: 0.186562 Aug 02 10:25:05.192960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 273/557] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1638 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:05.219887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:05.227927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-054d4c26-d561-4cec-8a65-6a0b2b8d5703 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.157710 Aug 02 10:25:05.228497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 285/558] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:05.254772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:05.257388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:05.263843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.265552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.265552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.265866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.295681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e54a4b68-c7af-459d-ba1c-55c0f8b5174d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 02 10:25:05.296212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 274/559] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:05.873462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:05.874180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:05.881757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.883695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.883695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.883695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.020940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.028392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb6c3ac3-8272-4c34-8aae-75950b847187 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.158876 Aug 02 10:25:06.028959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 286/560] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:05 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:06.037063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:06.037680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:06.044289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.046085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.046085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.046085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.180154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.187620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-686f87c1-2cb5-4728-8321-eeeea02344c8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.154660 Aug 02 10:25:06.188181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 275/561] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:06 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:06.249450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:06.250053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:06.256165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.256612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.257411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.257846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.307957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:06.310088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:06.316728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.317174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.318072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:06.318508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.349177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-67cd8ff9-f888-480a-8935-49efcb26acbf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Aug 02 10:25:06.350079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 276/562] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:06.388292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.396402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8eb7f122-5a1f-4a61-aa1c-752715de9624 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.150794 Aug 02 10:25:06.396967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 287/563] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:06 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:07.049784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:07.050339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:07.057023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.057461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.058216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.058644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.175772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:07.192066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.199552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de2d65a6-52c9-426b-84f8-4b4b696e3128 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1315 microversion: 2.1 time: 0.154197 Aug 02 10:25:07.200158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 277/564] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:07 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:07.209151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:07.209766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:07.213247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:07.216628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.217081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.217974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.218429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.355414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.362632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:07.364386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-26fda9c3-83ac-4a5d-bd4e-7ff72b2f9cda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.159227 Aug 02 10:25:07.364783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:07.364996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 288/565] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:07 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:07.367356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:07.372342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.372784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.373600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.373959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.405390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-96a7a9ba-7abc-42ba-b3eb-8d94c7148658 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Aug 02 10:25:07.409904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 278/566] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:07.418411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:07.422974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:07.425760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.426277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.427124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.427657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.491904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=26 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:07.610717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.620767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-16ce8921-791a-47da-8210-c64fe012259e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1272 microversion: 2.1 time: 0.206579 Aug 02 10:25:07.621801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 289/567] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:08.220357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.221016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.228027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.228474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.229233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.229668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.386936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.387644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.399217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.399217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.399217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.399217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.570306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.584075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-86dbae43-f1cb-4766-909b-9c6923713b90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.201751 Aug 02 10:25:08.585663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 290/568] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:08 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:08.598741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.601224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.608040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.608490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.609261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.609697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.629481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.640017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c69a36fc-a34c-4431-a024-f449ddf1f267 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1464 microversion: 2.1 time: 0.423301 Aug 02 10:25:08.640490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 279/569] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:08 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1464 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:08.645312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d213e74c-6fe9-4fb2-99e3-d722d590087c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057625 Aug 02 10:25:08.645986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.646202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 291/570] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:08.653041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.653959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.655942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.655942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.656318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.688211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.688704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.694803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.696246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.697042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.697476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.723056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:25:08.932288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.940002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0255ebf9-ee31-48ef-99ea-83d6d6aa82b9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.298225 Aug 02 10:25:08.940556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 280/571] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:09.100395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-53ad089c-c2f4-4aed-bd63-9575071e3e6f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 204 len: 0 microversion: 2.1 time: 0.415847 Aug 02 10:25:09.104481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 292/572] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:25:08 2022] DELETE /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:25:09.112956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:09.112956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:09.136884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.136884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.136884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.136884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.331552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:09.338824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-82a5a0b5-78b7-47c5-9acd-fd09ee6ed227 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1470 microversion: 2.1 time: 0.232840 Aug 02 10:25:09.339542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 281/573] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:09 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:09.609249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:09.610141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:09.618516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.619064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.619940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.620379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.663718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:09.666030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:09.673140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.673908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.674913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.675501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.732830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0420134c-489c-4ae1-94d1-4c3adfea874e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055688 Aug 02 10:25:09.732830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 282/574] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:09.780063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:09.788616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b868b1bb-6325-46fb-968e-0d53193dcc1d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.183940 Aug 02 10:25:09.789190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 293/575] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:09 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:09.808252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0f66275c-0b4d-49ac-a327-cd52f3c13161 req-fd246e79-2e8d-41cf-8e17-6ce4fdb36561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10a2ee2-07a5-43d7-b3f5-8f382de25a9b", "tag": "7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:09.818654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0f66275c-0b4d-49ac-a327-cd52f3c13161 req-fd246e79-2e8d-41cf-8e17-6ce4fdb36561 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.819090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0f66275c-0b4d-49ac-a327-cd52f3c13161 req-fd246e79-2e8d-41cf-8e17-6ce4fdb36561 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.830367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0f66275c-0b4d-49ac-a327-cd52f3c13161 req-fd246e79-2e8d-41cf-8e17-6ce4fdb36561 service nova] Creating event network-changed:7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8 for instance f10a2ee2-07a5-43d7-b3f5-8f382de25a9b on hv-cinder-84753 Aug 02 10:25:09.836351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0f66275c-0b4d-49ac-a327-cd52f3c13161 req-fd246e79-2e8d-41cf-8e17-6ce4fdb36561 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031509 Aug 02 10:25:09.836518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 283/576] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:09.967114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:09.967753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:09.978886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.979393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.980293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.980742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.117417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.125057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4679662a-b22c-4344-9f1b-f1c6f41d28d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.163062 Aug 02 10:25:10.125618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 294/577] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:10.363029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:10.363853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:10.370397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.370841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.371677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.372196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.507665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.515410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0f8754fe-e591-41b5-a846-2874fb88c701 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1470 microversion: 2.1 time: 0.157980 Aug 02 10:25:10.521291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 284/578] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:10 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:10.728333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:10.730411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:10.737021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.737459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.738216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.738649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.755479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:10.767694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2afc612-9ecb-4acc-a98d-8308e8144411 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Aug 02 10:25:10.768888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 295/579] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:10.816625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:10.817262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:10.823390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.823847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.824626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.825059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.957635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.965497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6c7abadd-842e-438e-b1c3-7f9b332cdb90 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153463 Aug 02 10:25:10.968994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 285/580] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:10 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:11.149013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:11.149966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:11.157736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.158322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.159282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.159878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.301785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:11.309338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-34a2302a-8d0f-4b09-b6fd-e5c30b84afa0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.166781 Aug 02 10:25:11.309937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 296/581] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:11.536971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:11.537756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:11.544486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.547551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.547551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.547551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.780626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:11.782767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:11.789599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.790041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.790815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.791276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.823890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99303ffe-f5eb-416b-a830-b3b3eda07002 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047178 Aug 02 10:25:11.824452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 297/582] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:11.959754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:11.967332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-68b6ea1f-f4bd-470d-b3a2-733f4b16221e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1470 microversion: 2.1 time: 0.434302 Aug 02 10:25:11.967908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 286/583] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:11 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1470 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:11.990053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:11.990516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:11.998597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.999047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.999869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.000325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.131870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:12.139712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cf050377-3b19-41c2-ae8c-39baefc40e45 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.156422 Aug 02 10:25:12.140404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 298/584] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:11 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:12.331273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:12.331918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:12.338082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.339141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.339970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.340693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.611805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:12.619111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cf9bc66e-2154-479f-b7ad-acbf33cf8c35 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.292336 Aug 02 10:25:12.619734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 287/585] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:12.652339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-3a06d316-d5b6-41cd-ad56-e724ed3356c2 req-7c901d0e-b4be-4958-ae9d-064673d12447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b253c788-4268-4547-9ab9-94a8e9a15d8e", "name": "network-vif-deleted", "tag": "09499b65-57d7-4907-b4cf-fb8436b1e8a3"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:12.664314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-3a06d316-d5b6-41cd-ad56-e724ed3356c2 req-7c901d0e-b4be-4958-ae9d-064673d12447 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.664755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-3a06d316-d5b6-41cd-ad56-e724ed3356c2 req-7c901d0e-b4be-4958-ae9d-064673d12447 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.677054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-3a06d316-d5b6-41cd-ad56-e724ed3356c2 req-7c901d0e-b4be-4958-ae9d-064673d12447 service nova] Creating event network-vif-deleted:09499b65-57d7-4907-b4cf-fb8436b1e8a3 for instance b253c788-4268-4547-9ab9-94a8e9a15d8e on hv-cinder-84753 Aug 02 10:25:12.682322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-3a06d316-d5b6-41cd-ad56-e724ed3356c2 req-7c901d0e-b4be-4958-ae9d-064673d12447 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 Aug 02 10:25:12.683127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 299/586] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:12.836811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:12.839021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:12.845484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.845925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.847348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.847782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.879735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ecd3d28e-490f-4e8e-8fbd-9a9f685278d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047382 Aug 02 10:25:12.880308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 288/587] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:12 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:12.991779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:12.992481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:12.999304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:12.999752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.000523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.000961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.062234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.069699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ebb8d64c-1bd0-4301-a969-57e57e690e44 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1300 microversion: 2.1 time: 0.082493 Aug 02 10:25:13.070260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 300/588] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:12 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:13.162737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:13.163334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:13.169414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.169863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.170624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.171058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.305008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.312427 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6214ad21-2426-4589-8aa5-7fbb3b825633 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.154331 Aug 02 10:25:13.313258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 289/589] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:13 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:13.640919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:13.641550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:13.648052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.648499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.649269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.649694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.781124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.789446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6a304d6-170c-4b41-b17b-d80268454e51 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.152370 Aug 02 10:25:13.789944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 301/590] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:13.891846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:13.894530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:13.901075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.901526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.902294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.902728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.905231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:13.933622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0fec4d9d-cade-4775-b3a6-548a810175a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Aug 02 10:25:13.934182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 290/591] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:14.091740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:14.092299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:14.098810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.099308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.100074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.100508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.132215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.132662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.133107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:14.173050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.180551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf7b2b77-5ccb-4ac5-8fd4-dc6610c2af63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093112 Aug 02 10:25:14.181110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 302/592] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:14 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:14.334515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:14.335127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:14.341206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.341651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.342458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.342844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.471309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.478940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83663e7b-3380-421d-bc22-4ecc62b558cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148732 Aug 02 10:25:14.479540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 291/593] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:14.810402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:14.810969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:14.817698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.818134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.818885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.819345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.949437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:14.956108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.956255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:14.958810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.958951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f457603b-21f0-4062-ac7c-72d6e44287da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.152359 Aug 02 10:25:14.959286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.959722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 303/594] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:14.960067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.960620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.989756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ccfb67e6-7a04-43b2-8536-bb6e72ece197 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Aug 02 10:25:14.995721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 292/595] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:15.202448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:15.202999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:15.209173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.209624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.210388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.210825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.242566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.243011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.243506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:15.285965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:15.294979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97d25bf0-e67f-4c0e-a0d1-8a1bbbdbc870 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096725 Aug 02 10:25:15.295605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 304/596] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:15 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:15.499778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:15.500391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:15.506932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.507414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.508176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.508610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.635868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:15.643213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eb639954-8656-4483-8be3-c16b9cf29d9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.147413 Aug 02 10:25:15.644406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 293/597] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:15 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:15.980251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:15.980819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:15.987298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.987788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.988554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.988992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.006000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:16.008175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:16.014722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.015164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.015954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.016385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.047350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd897051-7e5a-4cc5-ada5-23674d872014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Aug 02 10:25:16.047913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 294/598] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:16.126212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.134494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ce3248a0-a772-4b1b-97bc-4e97d98979c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.158242 Aug 02 10:25:16.135062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 305/599] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:16.316896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:16.317535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:16.323641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.324086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.324841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.325274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.359173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.359649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.360091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:16.404197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.412228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0002e476-fa22-4df6-b1a2-7884b68fe64a tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.099303 Aug 02 10:25:16.412788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 295/600] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:16 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:16.664969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:16.665524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:16.671586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.680339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.680339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.680339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.803112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.810663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bed4e507-6d3d-4eb8-8149-987db6e18a3f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.149888 Aug 02 10:25:16.811239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 306/601] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:16 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:17.059833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:17.061958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:17.069021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.069470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.070236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.070677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.100537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4768297e-8ffc-4990-a8f6-b52b4a19079e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Aug 02 10:25:17.101099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 296/602] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:17.155402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:17.156014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:17.163018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.163487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.164250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.164684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.307332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.314706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ceac8bbd-6c4e-4905-a26a-ec78e868c95a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.163267 Aug 02 10:25:17.315296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 307/603] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:17 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:17.433503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:17.434129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:17.440375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.441464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.442246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.442679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.473661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.474104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.474553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:17.515528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.523649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-634efc21-1cbf-46e3-bf67-a2b99c1997ee tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094258 Aug 02 10:25:17.524207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 297/604] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:17 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:17.832092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:17.832645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:17.838901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.839388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.840149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.840582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.970419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.977905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-af9df267-da85-4c4c-aa83-c94ca1617c71 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.150301 Aug 02 10:25:17.978471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 308/605] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:17 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:18.113090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:18.115350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:18.122238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.122687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.123490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.123977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.152975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1d77347-dd92-470d-9148-eec22e629f02 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 02 10:25:18.153529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 298/606] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:18.336374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:18.336976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:18.343457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.343895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.344643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.345069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.478391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:18.485948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5d5ebcc6-f368-4beb-821e-def9fa03b000 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.153501 Aug 02 10:25:18.486500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 309/607] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:18.545124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:18.545732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:18.552682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.553126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.553981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.554415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.584947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.585389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.585834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:18.628272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:18.635560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6003d100-14c8-41ac-8083-f17103141231 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094498 Aug 02 10:25:18.636116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 299/608] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:18 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:18.999737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:19.000353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:19.006411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.006863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.007673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.008107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.136964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.145078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78697bc0-2b42-4003-a197-12319bcc7257 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.149347 Aug 02 10:25:19.145648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 310/609] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:18 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:19.165669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:19.167863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:19.174281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.174735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.175539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.175976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.205349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cfa56b7a-0a03-4c9c-ab2e-956754d6cb79 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Aug 02 10:25:19.205828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 300/610] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:19.508541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:19.509183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:19.515687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.516163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.516924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.517337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.540538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-eb90791c-d170-4214-a444-3b4e3ad78f0a req-044cb95a-57e4-4af3-bee7-9e7c17e122f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10a2ee2-07a5-43d7-b3f5-8f382de25a9b", "name": "network-vif-plugged", "status": "completed", "tag": "7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:19.551311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-eb90791c-d170-4214-a444-3b4e3ad78f0a req-044cb95a-57e4-4af3-bee7-9e7c17e122f4 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.552143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-eb90791c-d170-4214-a444-3b4e3ad78f0a req-044cb95a-57e4-4af3-bee7-9e7c17e122f4 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.563850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-eb90791c-d170-4214-a444-3b4e3ad78f0a req-044cb95a-57e4-4af3-bee7-9e7c17e122f4 service nova] Creating event network-vif-plugged:7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8 for instance f10a2ee2-07a5-43d7-b3f5-8f382de25a9b on hv-cinder-84753 Aug 02 10:25:19.569802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-eb90791c-d170-4214-a444-3b4e3ad78f0a req-044cb95a-57e4-4af3-bee7-9e7c17e122f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038193 Aug 02 10:25:19.570398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 301/611] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:19.656714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:19.658069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:19.664217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.665113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.665562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.666337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.666767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.681870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-27922ec3-93e8-47f2-a45f-f26a7d8bf9d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.169631 Aug 02 10:25:19.681870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 311/612] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:19 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:19.706416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:19.706860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.707343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:19.747908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.755891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-16356d59-a4a9-4a37-8f78-f4637adcf2fc tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.103589 Aug 02 10:25:19.756387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 302/613] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:19 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:20.167279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:20.167824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:20.173841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.174292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.175696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.176146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.180223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:20.218149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:20.220532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:20.227744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.228181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.229007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.229442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.258988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-daecada9-b172-4e9f-8555-269ed9b23d47 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 02 10:25:20.259585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 303/614] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:20.309389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.316767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fe9dba96-d7a6-414b-8392-78d3fdef031c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153589 Aug 02 10:25:20.317321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 312/615] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:20 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:20.696791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:20.697313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:20.703442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.703883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.704664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.705091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.776481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:20.777094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:20.784163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.784163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.784949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.785383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.817268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.817704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.818152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:20.838696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.846414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-efceb8ca-d0bc-49a2-becb-2e64a22bfa28 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.153730 Aug 02 10:25:20.847033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 304/616] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:20.858232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.865952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d0e58936-b541-4749-a0fc-9354080ea1b7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093345 Aug 02 10:25:20.866780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 313/617] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:20 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:21.271213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:21.273461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:21.280022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.280466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.281218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.281651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.310730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3ca3b691-2d77-4771-8872-d5957113cf65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Aug 02 10:25:21.311294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 305/618] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:21.337342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:21.337958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:21.344052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.344501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.345260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.345698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.476629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:21.484098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9373a638-c3c9-4790-bea3-909460c33afd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.150617 Aug 02 10:25:21.484667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 314/619] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:21 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:21.868123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:21.868685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:21.874984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.875478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.876257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.876746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.880032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:21.887285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:21.887888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:21.894679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.895131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.896419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.896419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.928664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.929110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.929750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:21.970529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:21.978926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2574aa42-e847-4c0c-b375-d394d8c01bac tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095520 Aug 02 10:25:21.979528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 315/620] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:21 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:22.011000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:22.018633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-91530b04-fa25-42f1-aa58-1fd7c231c6a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.154920 Aug 02 10:25:22.019736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 306/621] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:22.322800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:22.325076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:22.331255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.332330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.333086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.333551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.363652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1c10608c-7a99-4b71-b104-6c375e7ed2e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Aug 02 10:25:22.364370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 316/622] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:22.506110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:22.506736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:22.513833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.519972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.519972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.519972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.652854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:22.661024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f861d2ad-2bec-449e-9908-85b559839b7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.158793 Aug 02 10:25:22.661570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 307/623] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:23.000337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:23.000957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:23.008032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.008534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.009290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.009726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.039763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:23.040310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:23.040882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.041334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.041787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:23.046272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.046825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.047616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.048052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.082185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:23.089733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-36275c6d-9246-4150-adb6-743a11f5cbe8 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093303 Aug 02 10:25:23.090303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 317/624] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:23.178798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:23.186656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea5c7f3d-7ae0-481c-845b-a81c76c5ecb6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.150712 Aug 02 10:25:23.187295 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 308/625] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:23.376870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:23.379890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:23.386000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.386450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.387241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.387686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.417413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2dc98f0c-7a5f-457a-991a-1b4ed382430b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Aug 02 10:25:23.417948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 318/626] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:23.682731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:23.683305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:23.689527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.689969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.690825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:23.691280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:23.822936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:23.830355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4eb3906-46a3-4483-97e6-86032f274897 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.151784 Aug 02 10:25:23.830925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 309/627] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:23 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:24.110405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:24.111044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:24.118188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.118631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.119416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.119850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.150756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.151210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.151668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:24.192611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:24.200246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e5cc591b-6834-4de1-b52b-02022ddd763e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093671 Aug 02 10:25:24.200809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 319/628] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:24 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:24.208003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:24.208737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:24.214837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.215316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.216107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.216562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.346571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:24.354150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9ad8a011-d76c-446f-a2a4-ae0785636a92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.149994 Aug 02 10:25:24.354707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 310/629] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:24.430525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:24.432632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:24.438567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.439088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.439904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.440346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.470873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-62aad045-1059-42fd-8eac-68657e905348 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Aug 02 10:25:24.471512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 320/630] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:24.851375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:24.851989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:24.858607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.859050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.859847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.860302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.992952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:25.000634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-347f88f9-04a4-4bf7-810c-81d7ed0469fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153788 Aug 02 10:25:25.001201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 311/631] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:24 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:25.221350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:25.221987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:25.228736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.229177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.229942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.230377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.261409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.261843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.262283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:25.305066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:25.312532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eefa96d0-6a58-40e2-9fb6-4d1be3c195ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095056 Aug 02 10:25:25.313090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 321/632] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:25 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:25.375289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:25.375905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:25.382648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.383024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.383843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.384276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.482116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:25.484309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:25.490507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.490949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.492151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:25.492466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:25.521167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:25.525179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6b1162b-3218-47ef-aadb-6404c2048507 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Aug 02 10:25:25.525749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 322/633] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:25.528828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-685f3a93-6119-4151-ad4e-5fd351e433a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.157512 Aug 02 10:25:25.534490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 312/634] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:26.021598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:26.022213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:26.028428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.028872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.029642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.030077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.159897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:26.167444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac50dac9-77ce-4052-b6f1-5e64dd034381 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.149738 Aug 02 10:25:26.167996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 323/635] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:26 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:26.333303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:26.333872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:26.336157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:26.340896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.341340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.342105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.342541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.374508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.374954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.375434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:26.416332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:26.423781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c46d184e-3ac0-4bfe-b628-967feaa32d99 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094934 Aug 02 10:25:26.424345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 313/636] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:26 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:26.538707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:26.540896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:26.547379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.547815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.548601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.549027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.549853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:26.550458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:26.556631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.557079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.557857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:26.558273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:26.577962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1adf798f-af46-4e82-b3d9-d6ceee614a76 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Aug 02 10:25:26.578508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 324/637] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:26.699124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:26.707203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3588ed7-5118-4fad-b284-36ddef6264f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.160752 Aug 02 10:25:26.707768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 314/638] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:27.188518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:27.189135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.195934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.196343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.197121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.197548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.325068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:27.332666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6c98856-ecaf-434e-b2b7-7431d92df7aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148126 Aug 02 10:25:27.333230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 325/639] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:27 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:27.444387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:27.444997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.451949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.452340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.453099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.453532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.484681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.485130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.485570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:27.529291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:27.537364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be73829f-27cf-402a-b954-5fa6dcb278e5 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096890 Aug 02 10:25:27.538011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 315/640] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:27 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:27.590977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:27.593185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.600170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.600675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.601446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.601885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.631682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb2a1c35-df8b-4161-9ba4-7eaf4aae8890 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Aug 02 10:25:27.632238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 326/641] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:27.720381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:27.723114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.728704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:27.729217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.729495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.729657 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.730415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.730850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.735395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.735843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.736601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.737032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.741595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:27.872729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:27.880391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4427af3c-0eee-4b7a-a664-1ac41f8c9e07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.155416 Aug 02 10:25:27.880934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 327/642] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:27.961980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-403e99cc-7b19-4149-abfe-b93fd3a58823 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action" status: 202 len: 0 microversion: 2.1 time: 0.245394 Aug 02 10:25:27.962664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 316/643] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:25:27 2022] POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:27.971066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:27.971656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:27.975428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:27.978908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.979390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:27.980147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:27.980579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.123625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:28.132141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-adfd2c18-38fd-45ac-810b-202a17a7dbc6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.165101 Aug 02 10:25:28.132701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 328/644] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:28.354544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:28.355275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:28.361553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.362000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.363432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.363866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.493489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:28.500910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-723b5f01-f4b5-4539-95d1-22760b29bbe6 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.150617 Aug 02 10:25:28.501474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 317/645] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:28 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:28.559434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:28.560080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:28.566381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.566828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.567622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.568062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.599754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.599754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.599754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:28.642128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:28.644485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:28.646786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:28.650215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c75626e-3636-4cda-84e4-54119182257b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094871 Aug 02 10:25:28.650790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 329/646] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:28 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:28.652995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.653443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.654209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.654643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.684268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-144c6dc3-f11b-4da3-b4aa-f94a2084dc2b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Aug 02 10:25:28.684823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 318/647] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:28.902189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:28.902706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:28.908788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.909225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:28.910347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:28.910916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.045468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:29.052873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4c378b2-ed78-40ca-a428-3d0338d49c68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.154768 Aug 02 10:25:29.053512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 330/648] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:28 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:29.165117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:29.165117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:29.165117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.165117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.165580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.165580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.307655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:29.315541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-efceffd1-51fb-4ab7-a8ea-e7e47154a1ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.166731 Aug 02 10:25:29.316093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 319/649] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:29.522268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:29.522968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:29.529138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.529579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.530336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.530765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.658557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:29.667022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f7f1a8d5-bdfa-488f-9c64-f63731343873 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148890 Aug 02 10:25:29.667636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 331/650] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:29 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:29.670973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:29.671621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:29.678763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.679224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.684415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.684415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.696589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:29.698913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:29.707024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.707705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.708564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.713078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.713177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:29.713177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:29.713177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:29.740875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75e260e9-676d-4b2c-ada3-fe5227f023cc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047671 Aug 02 10:25:29.741666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 332/651] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:29.754895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:29.757203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:29.763024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed3249d2-a7c4-46f2-a465-edf7e7c98b27 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095916 Aug 02 10:25:29.763604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 320/652] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:29 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:30.075716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:30.076366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:30.082537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.082999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.083816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.084410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.226235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:30.234159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dab8d508-831b-4335-b19a-0870c36a22fa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.162923 Aug 02 10:25:30.234736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 333/653] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:30.337386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:30.337915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:30.344675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.345121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.345874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.346308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.485958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:30.494730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f8943a7c-e5ee-4506-b3e4-99bf19b0373d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.161322 Aug 02 10:25:30.495309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 321/654] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:30.688590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:30.689139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:30.695637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.696075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.696830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.697260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.758266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:30.760624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:30.767069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.767547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.768319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.768755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.799238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-97fcd6ab-9c63-40f2-b2d7-b48ace075f5c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Aug 02 10:25:30.799809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 322/655] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:30.804262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:30.804871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:30.810681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.811128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.811926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.812362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.828552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:30.836485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9938f3e-3898-4e1c-95a6-a1b3f326553f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.151901 Aug 02 10:25:30.837052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 334/656] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:30 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:30.842912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:30.843402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:30.843848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:30.884094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:30.891449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-38bbfe9d-5e2f-4f7f-91a0-bd5f7868487d tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.090664 Aug 02 10:25:30.892090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 323/657] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:30 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:31.256094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:31.256709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:31.262641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.263076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.263879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.264306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.397154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:31.404748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aa706044-e69a-4ee3-8865-9da0b55f9640 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.152543 Aug 02 10:25:31.405320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 335/658] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:31.516955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:31.516955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:31.523469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.524016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.524772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.525196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.669921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:31.678179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de75b8dd-3cbc-47bf-9427-4567101e23b4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.165821 Aug 02 10:25:31.678736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 324/659] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:31.811416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:31.813615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:31.820632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.821087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.821832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.822259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.851499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-41cb7913-5664-4533-b727-f9618b613e38 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Aug 02 10:25:31.852491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 336/660] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:31.858351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:31.858964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:31.866151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.866603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.867670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.868109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.913098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:31.913713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:31.919982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.920429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.921189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.921619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.953213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:31.953658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:31.954101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:31.994909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:31.999540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:32.002564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18b56a30-fa35-4bfc-8048-1917936b2a26 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093689 Aug 02 10:25:32.003345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 337/661] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:31 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:32.008303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-94a75d6b-5fef-4325-a3ed-f0829a501beb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153801 Aug 02 10:25:32.008866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 325/662] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:31 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:32.426081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.426675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.432990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.433432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.434183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.434640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.563973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:32.572104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-04963be1-7585-40ab-bc2f-7e80b842fb6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.150111 Aug 02 10:25:32.572672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 338/663] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:32.700326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.703510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.709675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.710125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.710887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.711352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.863509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:32.864132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.866042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.872703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.872902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-88ce1f36-fbea-4e56-8593-5db0a9227b1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.176505 Aug 02 10:25:32.873148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.873311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 326/664] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:32.873927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.874365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.904438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2272cbcc-4ba0-4eee-ace0-5d1ee3666071 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Aug 02 10:25:32.905036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 339/665] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:33.025732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:33.026369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:33.029668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:33.030275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:33.032603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.033057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.033843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.034258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.036339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.036784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.038141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.038586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.070311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.070311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.070638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:33.112839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:33.121256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e7b81921-f8f4-49c9-9fd6-2c3a65076877 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.101207 Aug 02 10:25:33.121826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 327/666] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:33 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:33.176078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:33.184334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3fbb214d-b0d8-4684-9d69-4867806b4791 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.158584 Aug 02 10:25:33.184906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 340/667] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:33 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:33.594018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:33.594644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:33.600895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.602502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.602502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.602690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.732686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:33.740306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-91969765-5926-4eb0-bb10-c4cc107f82aa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.150478 Aug 02 10:25:33.740871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 328/668] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:33.893939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:33.894547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:33.901810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.902287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.903032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.903494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.916966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:33.919265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:33.926028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.926477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.927288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:33.927728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:33.958248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8240f526-3261-4231-9f3b-53ca81328391 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 02 10:25:33.958816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 329/669] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:34.049379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:34.057331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-91c82b5c-623d-4304-8e35-05a68c79bf7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.167295 Aug 02 10:25:34.057891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 341/670] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:34.141984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.142496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.149156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.149605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.150365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.150798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.181180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.181627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.182071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:34.205642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.206253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.212351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.212799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.213574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.214010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.226938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:34.234660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7629ca15-a69c-4d42-9870-25e6922f5a00 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096593 Aug 02 10:25:34.235249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 330/671] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:34 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:34.343999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:34.351842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3993b00-a536-43bf-aa1c-97b6d3848d12 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.150106 Aug 02 10:25:34.352433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 342/672] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:34 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:34.762629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.763252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.769192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.769635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.770381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.770809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.904087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:34.911780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6429534c-4fcd-43ec-8d4f-78308c29fe00 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.152844 Aug 02 10:25:34.912344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 331/673] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:34.970993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.973306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.980393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.980832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.981586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.982015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.985602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:35.011141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-deda28b8-08d7-43e0-bb78-f7849d6004d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Aug 02 10:25:35.011713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 343/674] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:35.078904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:35.079564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:35.086210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.086660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.087451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.087895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.233499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:35.241638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-463c8bd4-10fe-4848-a0b9-51fc81ef03c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.166647 Aug 02 10:25:35.242458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 332/675] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:35.255991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:35.256599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:35.263049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.263551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.264307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.264739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.295804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.296250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.296754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:35.341290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:35.348771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4de572dd-ef7a-4e95-a8c7-8aac915e964f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096651 Aug 02 10:25:35.349370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 344/676] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:35 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:35.372909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:35.373426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:35.379478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.382517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.382517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.382517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.513749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:35.521682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-296531c2-c444-483b-a3ab-056d4c4f7aa5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.152755 Aug 02 10:25:35.522247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 333/677] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:35 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:35.933500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:35.934106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:35.940124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.940565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:35.941317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:35.941750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.023766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.026102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.032333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.032767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.033536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.033970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.064368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cdf3cdda-d0cf-46bf-9fe2-bcd08df27163 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Aug 02 10:25:36.064939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 334/678] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:36.072011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:36.079504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6043fa71-15ae-4d33-8507-55e54270a79f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.150270 Aug 02 10:25:36.080067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 345/679] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:36.267594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.268210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.275092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.275565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.276328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.276752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.372753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.377313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.390488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.390930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.391725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.392155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.419842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:36.426394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.426394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.426394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:36.427954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b618c5d-55f3-476f-899b-99901d37fe6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.167852 Aug 02 10:25:36.428525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 335/680] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:36.465733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:36.473202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b57b292f-d701-4a16-8aa3-83bd2f67a570 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.106965 Aug 02 10:25:36.473772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 346/681] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:36.542310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.542922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.549167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.552275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.552275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.552275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.565880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:36.685073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:36.692472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7073ebf0-c374-481f-b9e8-24616100ef5a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.154522 Aug 02 10:25:36.693069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 336/682] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:37.076970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.079248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.086400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.086841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.087637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.088078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.099389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.100007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.106131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.106586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.107400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.107841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.120736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b171a8f0-3348-4ff1-a1d0-5926f94a0875 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Aug 02 10:25:37.121538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 347/683] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:37.240409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:37.248338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b5ca9002-9956-4235-aed5-45e38c69ec2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.152803 Aug 02 10:25:37.248905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 337/684] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:37.449203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.449723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.455893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.456338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.457095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.457536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.494123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.494766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.501383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.501832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.502597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.503034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.537737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.538052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.539085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:37.578516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:37.586592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b3f31895-c7aa-4b6d-8d13-a4bbe8606639 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096594 Aug 02 10:25:37.595744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 338/685] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:37.606983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:37.615220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-07be0138-65e9-4055-95d5-d96f67f8bc93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.169930 Aug 02 10:25:37.615797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 348/686] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:37.618729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.619242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.625582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.626052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.626801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.627280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.655667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c257483-cc40-4268-8bd2-eebf6af9ffba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments/dd43e4d1-4601-492e-a3c0-d7cc13bd6f89" status: 200 len: 194 microversion: 2.20 time: 0.042366 Aug 02 10:25:37.656245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 339/687] 10.222.0.49 () {60 vars in 1454 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments/dd43e4d1-4601-492e-a3c0-d7cc13bd6f89 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:37.714076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.714941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.721032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.721477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.722240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.722678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.728287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.728791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.735330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.735779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.736548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.736981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.820137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lazy-loading 'services' on Instance uuid 694dcbbc-916c-4b2a-b571-9225b4c1127f {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:37.856257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:37.863873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2ac5257-4c3c-47fb-a214-1490ebec10cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153876 Aug 02 10:25:37.864750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 349/688] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:38.083472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d80a1825-115d-4519-8be2-8ef25be2fc1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments/dd43e4d1-4601-492e-a3c0-d7cc13bd6f89" status: 202 len: 0 microversion: 2.20 time: 0.358970 Aug 02 10:25:38.084099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 340/689] 10.222.0.49 () {60 vars in 1457 bytes} [Tue Aug 2 10:25:37 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments/dd43e4d1-4601-492e-a3c0-d7cc13bd6f89 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:25:38.093494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.097741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.102826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.103305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.104092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.104506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.135584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.136129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-15bdc1f0-425e-4a77-a7e8-5682e96c366d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046720 Aug 02 10:25:38.136714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 350/690] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:38.138035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.144838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.145280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.146054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.146484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.181009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0b338747-71c2-4215-afda-a04120f3cfef tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050133 Aug 02 10:25:38.181573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 341/691] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:38.270163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.270776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.277506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.278128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.278900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.279362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.413929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:38.422119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-160c3ae5-4903-4966-8d43-1ae140fde773 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.155947 Aug 02 10:25:38.422699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 351/692] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:38.607077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.607717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.615024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.615586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.616415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.616917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.637793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.638402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.644610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.645053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.645821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.646298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.649706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.650153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.650615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:38.693705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:38.701863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7274d7b4-10c5-48fe-a30b-c5caa503cc36 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.098833 Aug 02 10:25:38.702464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 342/693] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:38.785934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:38.793817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-35a573ca-a02e-4be7-b979-cd603532b4ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.159917 Aug 02 10:25:38.794382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 352/694] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:38.886580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.887179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.893166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.893598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.894343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.894767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.021794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:39.029448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9541fcce-8459-457f-b5f5-b7226359681a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.147355 Aug 02 10:25:39.030010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 343/695] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:39.151381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:39.153627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:39.160084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.160535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.161300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.161740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.193466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:39.193706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6d7e8042-494d-44be-8ab4-57537a8b6222 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046107 Aug 02 10:25:39.194050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 353/696] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:39.196309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:39.202503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.202953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.203829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.204267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.232522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0120b5a1-ec9d-4365-a03a-21add9b7022c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Aug 02 10:25:39.233073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 344/697] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:39.442706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:39.443270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:39.449412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.449869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.450627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.451069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.581964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:39.589982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-38fb5aac-215a-4b39-9eaf-7a3167649878 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.151312 Aug 02 10:25:39.590548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 354/698] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:39 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:39.723160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:39.723792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:39.730472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.730912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.731730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.732185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.764422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.764862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.765301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:39.804837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:39.812275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e6febbf5-941d-4a28-bc23-14e41d402313 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093049 Aug 02 10:25:39.812865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 345/699] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:39 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:39.814244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:39.814922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:39.821694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.822142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.822916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.823395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.971288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:39.979338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b32ac5b6-3dc0-4ec1-8a33-dcd318492aa6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.169076 Aug 02 10:25:39.979915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 355/700] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:40.049717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.050334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.057051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.062470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.062470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.062470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.189485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:40.197787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-85e93478-c953-446a-a3f1-5092ae69d39d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.151909 Aug 02 10:25:40.198354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 346/701] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:40.206340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.208649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.215977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.216425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.217201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.217625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.245176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.246394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-76ce4324-5354-40da-a6a3-66a6bede0cef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 Aug 02 10:25:40.246975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 356/702] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:40.247276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.253710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.254157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.254938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.255405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.286042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-14123790-038c-4651-840a-f5ef79088e36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Aug 02 10:25:40.286598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 347/703] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:40.609950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.610606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.616854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.617545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.618310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.618747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.746729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:40.754284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-29f1cc14-14b9-4947-b3a9-4ad2735befa6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.148268 Aug 02 10:25:40.754848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 357/704] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:40.839358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.839890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.847019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.847501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.848274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.848708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.879719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.880174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.884507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:40.920855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:40.928410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6ef235b9-5fa2-42d2-b78d-71029d8bd4a7 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093489 Aug 02 10:25:40.929118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 348/705] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:41.001557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.002173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.008406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.008859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.009625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.010062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.153153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:41.161132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b432f159-f4c1-400b-8fae-1172636c4d57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.163517 Aug 02 10:25:41.161691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 358/706] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:41.219213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.219825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.226063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.226508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.227307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.227745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.258728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.260883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.267365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.267805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.268590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.269021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.273207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:41.299861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a9e5348-1ae8-45d4-aa19-53bb12433e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045692 Aug 02 10:25:41.300637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 359/707] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:41.305097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.307238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.313504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.313945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.314699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.315245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.345734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-03e815bf-0964-4d5b-bf59-8cefcf4368b7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 02 10:25:41.346226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 360/708] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:41.367151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:41.374748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0599f53f-6371-498e-866b-5f8309d47dc0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.159383 Aug 02 10:25:41.375334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 349/709] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:41.775358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.775960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.782025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.782463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.783726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.784492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.921361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:41.929403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b56433de-894c-4107-9a24-23838ff979b8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.157448 Aug 02 10:25:41.929961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 361/710] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:41.949703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.950316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.956833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.957283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.958083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.958518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.988677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.989308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.989763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:42.033376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:42.035618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:42.042081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1ce6e487-1e55-40d9-bee3-0dbc887f36e6 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096184 Aug 02 10:25:42.042636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 350/711] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:42.182290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:42.182930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:42.189119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.189567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.190341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.190781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.312425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:42.314760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:42.322487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.322935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.323745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.324182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.337787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:42.345840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ae7e34b3-db2e-448c-ab8e-5802365f2c26 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.167463 Aug 02 10:25:42.346544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 362/712] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:42.354567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d9c85b08-a1a8-4f5b-b928-74ff5fb2e4a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046162 Aug 02 10:25:42.355281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 351/713] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:42.357887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:42.360117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:42.366030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.366507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.367287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.367971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.395825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:42.396425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:42.396592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-12126324-7e4f-4ab1-a1dd-83cc25da48cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Aug 02 10:25:42.397141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 363/714] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:42.398898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:42.403825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.404454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.405053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.405484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.532762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:42.540213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-913e4263-f103-49dd-a81c-3f6beae900a0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148615 Aug 02 10:25:42.540770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 352/715] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:42 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:42.950705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:42.951505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:42.957675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.958123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:42.958945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:42.959417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.061870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:43.062478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:43.068937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.069375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.070139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.070567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.088774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:43.096322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f67dfeb9-353e-49d0-b192-7112436d4163 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.149566 Aug 02 10:25:43.096926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 364/716] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:42 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:43.102059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.102519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.102958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:43.142842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:43.150629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd9abe6a-c5a6-49ea-b0dc-a1856784bcbb tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.092613 Aug 02 10:25:43.151219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 353/717] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:43 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:43.367809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:43.368395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:43.368497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:43.369941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:43.374615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.375070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.375856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.376296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.376417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.376744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.377506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.377942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.408608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b258a703-ec0c-478b-87d1-f2853b8cdcf1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045666 Aug 02 10:25:43.409166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 365/718] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:43.414423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:43.416593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:43.422490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.422931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.423732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.424169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.453434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9119a481-15d6-4d09-8952-02903af22d7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Aug 02 10:25:43.453869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 366/719] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:43.523937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:43.532035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8933e8d3-2b23-4d88-b061-3cc4e08291f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.168783 Aug 02 10:25:43.532602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 354/720] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:43.561459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:43.562105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:43.568220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.568670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.569436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:43.569875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:43.699362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:43.706764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3ab9f635-9119-4a08-9007-42cf04854407 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.149225 Aug 02 10:25:43.707359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 367/721] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:43 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:44.118728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.119368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.125924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.126413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.127143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.127590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.171478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.172111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.178147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.178651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.179994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.180436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.212104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.212578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.213027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:44.255727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:44.263166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:44.263677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6bca82e5-81ad-4fdb-8d42-3b23981553a4 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095938 Aug 02 10:25:44.264258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 368/722] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:44.270708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eadd4965-0f8a-4619-86c4-6fe913d648d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.156124 Aug 02 10:25:44.271277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 355/723] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:44.421193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.423384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.429397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.429843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.430607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.431044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.460912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f133d071-dbde-4fde-b4d6-b7ac48fac295 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Aug 02 10:25:44.461463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 369/724] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:44.466300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.468610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.474628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.475069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.476542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.477019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.505390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0b94d7a-d926-49a5-adb0-14683315de7e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Aug 02 10:25:44.505943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 356/725] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:44.553913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.554558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.560707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.561198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.561955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.562391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.702951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:44.711744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-13c31fe7-43c2-4b53-bc0f-dd066bd9af79 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.161840 Aug 02 10:25:44.712344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 370/726] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:44.728665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.728665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.734296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.734748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.735616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.736052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.861993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:44.870905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b52b67df-b21c-492f-a241-27783ace62ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.147760 Aug 02 10:25:44.871508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 357/727] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:45.284930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.285555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.292320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.292869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.292869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.293161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.293665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.294519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.300300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.300757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.301532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.301976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.325788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.326244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.326697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:45.368909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:45.376977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-900e7f3b-397e-4ff1-b6de-0fb398ee18e2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095695 Aug 02 10:25:45.377553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 371/728] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:45.440282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:45.448610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69b0d280-fe91-459b-adbb-319a0cee935a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.160748 Aug 02 10:25:45.449167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 358/729] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:45.473386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.475614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.478935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:45.482388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.482835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.483631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.484075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.514124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9240e16-61a0-4cba-bb7d-4c8658692628 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044823 Aug 02 10:25:45.514701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 372/730] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:45.518257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.520549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.527356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.527837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.528595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.529293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.558840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fffc7d23-5b71-4c0b-8f47-2c04ac1402f1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Aug 02 10:25:45.559549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 359/731] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:45.732766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.733300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.739584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.740034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.740793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.741857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.883011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:45.891109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e51119ae-5abd-4670-a44c-3a8eff23e155 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.162589 Aug 02 10:25:45.891865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 373/732] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:45.892593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.893212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.899242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.899705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.900466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.900900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.027963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:46.035380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-10cad772-aef1-412b-8968-ea54d6729104 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.146677 Aug 02 10:25:46.035946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 360/733] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:46.398203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:46.398822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:46.405250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.405705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.406522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.406959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.437386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.437834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.438278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:46.470200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:46.470836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:46.482616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.482616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.482616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.482878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:46.483336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.483887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:46.490020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ff73dd80-4024-475c-8d98-1226eca3994c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.096045 Aug 02 10:25:46.490606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 374/734] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:46 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:46.526727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:46.528947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:46.535763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.536204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.536981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.537478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.567952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b4bc910f-ebfe-45f8-8358-627b246bf171 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Aug 02 10:25:46.568542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 375/735] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:46.573416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:46.575721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:46.581800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.582252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.583023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.583498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.613725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b7c61a36-eb0f-4531-8fd5-b8ec1ce51ede tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Aug 02 10:25:46.614315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 376/736] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:46.622973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:46.630767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a8e7d418-3cbd-4949-8d44-a635e1cdf22b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.164470 Aug 02 10:25:46.631348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 361/737] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:46 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:46.912602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:46.913696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:46.919854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.920293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:46.921069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:46.921494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.057501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:47.058154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:47.062846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:47.064451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.068402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.068402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.068402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.070988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c3b7721-1124-4552-9053-3e52baaa5420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.162377 Aug 02 10:25:47.071604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 377/738] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:47.194024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:47.201580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b6fd79e5-e0ce-4b9a-9d0d-ead2a0680e8b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148494 Aug 02 10:25:47.202139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 362/739] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:47 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:47.517260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:47.520085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:47.525263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.525751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.526536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.526973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.558605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.559053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.559545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:47.580255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:47.582614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:47.590253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.590689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.591480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.591911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.603746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:47.611258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c9d67de8-fc1c-4def-8a92-5f7e9c132955 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.097874 Aug 02 10:25:47.612018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 378/740] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:47 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:47.622564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca7bdfd0-db6b-40b3-a150-faa3798636ca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046340 Aug 02 10:25:47.623292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 363/741] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:47.626017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:47.628268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:47.635533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.635971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.636727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.637156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.653993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:47.654714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:47.660834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.661280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.662041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:47.662473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:47.666654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9742aeed-8340-4407-9d11-8056b5aafcd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 02 10:25:47.667412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 379/742] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:47.793634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:47.801300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc12afd5-dd45-4767-99e0-765c543e3ff1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.151870 Aug 02 10:25:47.801859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 364/743] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:48.092596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.093121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.099179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.099646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.100404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.100839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.223062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.224447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.234920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.235395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.236202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.236626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.243294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:48.251654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-00e6aedb-f351-4a22-b320-0283a8c87106 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.163096 Aug 02 10:25:48.252225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 380/744] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:48.369021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:48.376364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f7c10bfc-9d41-456a-848e-0b2d9e2f835c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.157753 Aug 02 10:25:48.376918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 365/745] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:48.632667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.633196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.635325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.637483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.639910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.640363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.641147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.641582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.643951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.644419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.645165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.645588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.673833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.674280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.674734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:48.675721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18a1080f-5b30-4610-9dc6-0a97a6ad03fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044270 Aug 02 10:25:48.676293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 366/746] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:48.680841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.683023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.688953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.689388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.690144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.690572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.694231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:48.715041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:48.720872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e039d671-4fb7-435f-aa0e-38250682502b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Aug 02 10:25:48.721513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 367/747] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:48.722659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-86391075-a20e-4c69-96ad-3bb6db8b48de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093988 Aug 02 10:25:48.723232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 381/748] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:48.822038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:48.822635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:48.829138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.829575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.830388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:48.830841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:48.965519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:48.973189 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-57f7c9f3-b7a8-4d1e-98b9-6416c3d86c0d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.154928 Aug 02 10:25:48.973751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 368/749] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:48 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:49.274736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.275393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:49.281737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.282180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.282941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.283431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.397073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.398318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:49.404551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.405000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.405793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.406216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.427566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:49.435648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-362d40d9-57fb-4861-a97c-4cc0825a8cb1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.164875 Aug 02 10:25:49.436302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 382/750] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:49.539353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:49.546711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7cdcf964-1878-4645-8dda-058edb2da683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.153500 Aug 02 10:25:49.547298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 369/751] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:49.687566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.689717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:49.696142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.696591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.697355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.697861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.727458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d9939c6-a0d5-483c-95f3-98872f6ec1cc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043811 Aug 02 10:25:49.728033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 383/752] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:49.733348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.735514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:49.742172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.742616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.743514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.743753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.744115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:49.744243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.749976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.750409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.751153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.751601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.773727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-33ff7ccf-74ce-44f1-ac76-6b55401c1174 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 02 10:25:49.774298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 370/753] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:49.781832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:49.782272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:49.782708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:49.822589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:49.830083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-380dd0ee-a0c0-4743-b78f-3ff8ff470a40 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.090741 Aug 02 10:25:49.830646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 384/754] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:49.995114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:49.995764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.001842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.002293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.003054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.003533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.131813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:50.139937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d6257cf1-dfc3-4e2c-add4-9066d51ff7c7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.149023 Aug 02 10:25:50.140496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 371/755] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:50.457459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.458129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.464429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.464871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.465631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.466063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.568039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.568646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.575067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.575606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.576384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.576820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.607166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:50.615412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3288e5db-01f7-404d-b85c-d658328d7f41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.161707 Aug 02 10:25:50.616071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 385/756] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:50.707605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:50.715016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-150bc52e-69bc-4771-b0ce-5376cef0e1ec tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.151081 Aug 02 10:25:50.715602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 372/757] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:50.739758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.742539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.749430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.749880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.750652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.751080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.779374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7368ef38-4958-4e05-8910-250b7598c344 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043567 Aug 02 10:25:50.779926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 386/758] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:50.785993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.788737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.795465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.795914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.796675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.797108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.826088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-010679e7-2233-43b9-a606-29610ab9f8f6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 02 10:25:50.826645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 373/759] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:50.852349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.852963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:50.858999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.859432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.860192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.860629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.894018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:50.894462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:50.894906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:50.939152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:50.946803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5bf94e3-0269-4380-88cc-b77c353179de tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.098822 Aug 02 10:25:50.947386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 387/760] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:51.161848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.162341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.168996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.169442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.170191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.170681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.299410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:51.306929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3177cc22-5a06-4338-be46-88017a897753 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.149114 Aug 02 10:25:51.307537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 374/761] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:51.637993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.638610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.645041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.645495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.646257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.646694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.736680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.737305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.744248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.744728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.745508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.745957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.789807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:51.797855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-40e1ed7a-a279-48b2-ba8c-7ba8e8a89168 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.163781 Aug 02 10:25:51.798426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 388/762] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:51.803388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.806014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.812842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.813740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.814067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.814504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.845231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a403d9f4-0648-4270-bbe7-a7f181659207 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045722 Aug 02 10:25:51.846106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 389/763] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:51.850704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.852870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.859269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.859722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.860495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.860937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.864608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:51.881344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:51.887278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e683a785-a5be-4389-bcaa-7688541d6075 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.154495 Aug 02 10:25:51.888015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 375/764] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:51.892469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06cee7ae-5eb9-4eeb-acc9-7bd8f3be73e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Aug 02 10:25:51.893064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 390/765] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:51.967213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.967828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:51.974031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.974475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.975268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.975791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.006823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.007838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.008281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:52.050784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:52.058982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f170a36a-a481-4b93-ac6d-5985018f11d9 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.095622 Aug 02 10:25:52.059593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 376/766] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:52.328919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.329389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.336223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.336662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.337413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.337833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.468255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:52.475839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aded3f01-c3ee-46d8-a94a-8d61772dcc52 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.151423 Aug 02 10:25:52.476403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 391/767] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:52.826566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.827200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.834010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.834455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.835325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.836267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.857582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.860014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.866616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.867061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.868271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.868696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.898903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-775a84e1-d588-4033-89d1-567ebd3b3c0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045220 Aug 02 10:25:52.903724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 392/768] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:52.904930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.907057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.913094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.913543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.914551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.914771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.944185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-28cab626-ce47-4968-b5a9-deeb490f302f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Aug 02 10:25:52.945246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 393/769] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:52.950678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.951320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.957793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.958229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.958993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:52.959466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:52.983119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:52.991408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e989d526-b4db-49a9-b4bb-0be1911343b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.168512 Aug 02 10:25:52.991795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 377/770] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:53.079933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.080470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:53.087089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.087564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.088465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.089239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.090483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:53.098032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f7e61717-d1eb-40ab-99d3-fb7e655877fc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.151820 Aug 02 10:25:53.098590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 394/771] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:53.121437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.121882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.122322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:53.161830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:53.169359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83140f95-37db-4ba6-b5c6-ec15625349b2 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093489 Aug 02 10:25:53.169944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 378/772] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:53.498589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.499239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:53.505322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.505772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.506510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.506942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.637986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:53.645404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-95994f45-8b69-4260-a43b-63b0634f86d9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.150678 Aug 02 10:25:53.645960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 395/773] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:53.911724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.913993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:53.920070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.920518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.921283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.921738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.951329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-663ee832-7dfa-4aaa-9d47-7f775156c7ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043746 Aug 02 10:25:53.952046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 379/774] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:53.957183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.959381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:53.965874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.966315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.967106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.967570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.996393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-87e93bac-f996-4860-bef9-45072fa7d963 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Aug 02 10:25:53.996952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 396/775] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:54.012965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.013576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.019658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.020106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.020861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.021313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.119887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.120500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.127798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.128250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.129039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.129472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.167820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:54.176015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2f61c908-60fb-49b5-b890-c178d1fe81e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.166815 Aug 02 10:25:54.176561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 380/776] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:54.190539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.190539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.197153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.197665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.198593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.199019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.229640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.230089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.230547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:54.273009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:54.280990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7640110e-c4b3-468f-8223-97958c597d21 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094970 Aug 02 10:25:54.281574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 381/777] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:54.480473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:54.487953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-66fb4b88-9e17-4940-97c3-ef59bd315164 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.372817 Aug 02 10:25:54.488517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 397/778] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:54.667340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.667956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.674278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.674721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.675502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.675935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.803984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:54.806286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:54.812165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f3b6610d-a4be-4fde-bf40-b3cc5d2866d6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.149376 Aug 02 10:25:54.814129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 382/779] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:54.964119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.966296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.972783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.973228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.974031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.974468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.003761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2815bbe5-fc01-4760-9e70-88cad59a474c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044166 Aug 02 10:25:55.004244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 398/780] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:55.008901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.011254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.018308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.018887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.019545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.019984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.049489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-145af76e-ed78-4f66-82ab-c2efd865b164 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Aug 02 10:25:55.050043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 383/781] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:55.198188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.198801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.205961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.206409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.207172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.207636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.302147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.302755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.309781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.310233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.310998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.311458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.342731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.343243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.343706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:55.351171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:55.359873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc1d3425-f969-4630-977f-c32279dc62a2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.165370 Aug 02 10:25:55.360495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 399/782] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:55.390932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:55.399062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0cd9f7e0-97ee-4eae-b7b7-5491e3e1e0ec tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.100987 Aug 02 10:25:55.399660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 384/783] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:55.509677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.510282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.516362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.516807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.517568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.517999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.646976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:55.656315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c0a297d-27e7-47f9-b1da-899cd8757ce7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.150430 Aug 02 10:25:55.656887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 400/784] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:55.832796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.833322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.840039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.840486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.841245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.841675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.969937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:55.977817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b76a11a9-c722-4538-b1aa-71a4e06ceaf6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.148709 Aug 02 10:25:55.978364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 385/785] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:56.015890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.018188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.024876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.025318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.026097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.026525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.055218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e8139eca-bc59-4269-a20c-e2bbc57f1dea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043221 Aug 02 10:25:56.056405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 401/786] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:56.062275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.064508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.070989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.071463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.072230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.072668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.101836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da945488-cfc3-47a2-9f5e-d1bd426a3383 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Aug 02 10:25:56.102810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 386/787] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:56.383060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.384176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.390164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.390619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.391458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.391899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.419542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.420153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.426502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.426940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.427741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.428171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.460415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.460855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.461298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:56.501418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:56.510417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9eda91de-3e40-4d96-be2f-ab702c2b0eb1 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.094677 Aug 02 10:25:56.519084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 387/788] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:56.543585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:56.551563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-04398caf-13fe-49bd-aab7-03e124459103 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.172578 Aug 02 10:25:56.552117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 402/789] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:56.678076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.678607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.685280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.685724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.686480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.686913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.999116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.999731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:57.006702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.007203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.007985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.008415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.068936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:57.077085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e353689e-ecc9-4adb-8c5e-1edcf67361ad tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.402988 Aug 02 10:25:57.077839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 388/790] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:57.082313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.084558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:57.090994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.091425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.092197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.092638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.123609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58b61b1e-64e6-4567-bcb8-8a9a962ede2d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Aug 02 10:25:57.124169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 389/791] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:57.129108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.130966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:57.137202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.137649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.138471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.138912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.149689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:57.157449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e54eb5f3-721c-4cb6-8fd6-5fbdcf68f7f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.162317 Aug 02 10:25:57.158150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 403/792] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:57.169927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b786b450-1792-4dd7-8cfb-db6c8c419f3b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Aug 02 10:25:57.170463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 390/793] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:57.663737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.663737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:57.663737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.663737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.665941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.665941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.666118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.666118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:57.666295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.666295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.666295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:57.666525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.666525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.666525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.666525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.666847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:57.666847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6df19e44-a545-4e37-ad46-dbc23e36bd12 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.099189 Aug 02 10:25:57.666847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 404/794] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:57.731447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:57.739497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a9972136-87cc-49a3-9dea-d8c8391df42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.169122 Aug 02 10:25:57.740053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 391/795] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:58.098767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.099467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.106892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.107392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.108161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.108634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.141364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.143602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.150770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.151234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.152004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.152464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.182089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1d5d9211-41ea-463a-bb78-3fb2ee1cfafb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045184 Aug 02 10:25:58.182751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 392/796] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:25:58.187417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.188025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.194060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.194494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.195276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.195815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.248594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:58.256409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18c9b5f7-d2d5-47ae-9ae2-c7be767687fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.161675 Aug 02 10:25:58.256980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 405/797] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:58.262471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.265304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.273411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.273411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.273633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.273935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.291922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:58.305397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc0df7ff-3804-4f40-9586-3ff1d528ab5f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047381 Aug 02 10:25:58.305960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 406/798] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:58.331549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:58.339595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5a6c3fe9-80a6-4e7f-9edf-781d588b9d09 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.155783 Aug 02 10:25:58.340214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 393/799] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:58.652926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.653528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.659629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.660069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.660860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.661272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.692253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.692697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.693139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:58.734341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:58.741653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-05b879c4-cb5c-47f9-b13a-99038e5c995b tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093003 Aug 02 10:25:58.742590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 407/800] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:58.761042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.761660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.767951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.768396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.769203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.769635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.908449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:58.916984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-374b2feb-3c25-495d-bd76-66b1ef932572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.160476 Aug 02 10:25:58.917552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 394/801] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:59.194342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.196442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.202982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.203474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.204241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.204679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.236189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fb8c2f0b-3690-4152-93d1-013f31722e9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045927 Aug 02 10:25:59.236746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 408/802] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:25:59.278521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.279125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.285565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.286002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.286782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.287218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.316710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.318898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.325399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.325854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.326628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.327067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.358436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6514ac67-8efd-4cf7-9b05-3d0759f7a29f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 02 10:25:59.359269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 409/803] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:59.363612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.364261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.370671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.371126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.371936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.372372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.420927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:59.429360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-705207b7-355c-469b-bbc2-85f552f0031d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.155170 Aug 02 10:25:59.429929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 395/804] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:59.508422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:59.515691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-489bd0c4-91ec-492e-a6a7-c5cf6ff20ad7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.155550 Aug 02 10:25:59.516255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 410/805] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:59.763540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.764182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.766032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:59.770822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.771302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.772111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.772531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.803487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.803931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.804374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:59.844146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:59.852062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cece3f5b-e487-4987-8d51-a456df9ae43e tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093115 Aug 02 10:25:59.852625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 396/806] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:59.939953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.940563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.946628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.947775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.948592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.949030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.089491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:00.097416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ab0bce9-3095-47b2-8615-3642f68b4770 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.161392 Aug 02 10:26:00.098020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 411/807] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:00.249205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.251531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.257611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.258063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.258824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.259301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.288056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e103425-8fa1-4688-819d-51dc3a83b9df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042783 Aug 02 10:26:00.288757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 397/808] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:00.370908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.373263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.379909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.380358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.381124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.381558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.410598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0cee94af-1403-4b00-be9a-7f3823f289fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Aug 02 10:26:00.411160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 412/809] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:00.449731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.450345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.456522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.456972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.457741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.458176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.472732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:00.537508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.538371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.544998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.548214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.548214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.548214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.594080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:00.601843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-796eb32d-1527-424f-8b36-09f7daca6b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.155714 Aug 02 10:26:00.602452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 398/810] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:00.687432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:00.694999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9fc272f7-0705-4116-af59-f3764421a166 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.161334 Aug 02 10:26:00.695594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 413/811] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:00.873337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.873994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.880034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.880474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.881231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.881688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.911509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.911973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.912408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:00.953223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:00.961063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6d2eac1d-360c-431d-af60-d7921e110c63 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.091627 Aug 02 10:26:00.961695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 399/812] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:01.118612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.119336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.125489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.125876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.126785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.127243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.267100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:01.275090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-15f9e5a2-1a81-4ce9-ac1c-e1ac703f1a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.160641 Aug 02 10:26:01.276268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 414/813] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:01.301008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.303148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.309605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.310046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.310836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.311296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.341133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a9c80beb-788c-468d-be38-7e8f53dd2244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044190 Aug 02 10:26:01.341675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 400/814] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:01.422484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.424593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.427932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:01.431854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.432303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.433065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.433498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.462856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2df99790-01d0-4e2f-9429-074b450ac276 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 02 10:26:01.463440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 415/815] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:01.624557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.625156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.631319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.631765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.632521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.632952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.716838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.717456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.724117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.724572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.725342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.725777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.765801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:01.773467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d66fae02-9886-4a73-bdc9-138cddb48df3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.152886 Aug 02 10:26:01.774037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 401/816] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:01.862469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:01.870968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-175b4a0c-3ee3-4a01-b787-bfbf3a5858f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.158170 Aug 02 10:26:01.871550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 416/817] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:01.982497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.983013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.989043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.989531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.990277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.990703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.020837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.021269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.021703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:02.061562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:02.068888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5acf5ce2-5580-419e-8f90-30a6ea772f7f tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.090890 Aug 02 10:26:02.069449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 402/818] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:02.297620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.298135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.304322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.304769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.305531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.305967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.354224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.356564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.363004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.363492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.364274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.364714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.394576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c33fada1-6ef3-41f1-8698-d9f81e77dfc8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045009 Aug 02 10:26:02.395155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 403/819] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:02.447345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:02.455628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-12463351-0913-4263-9a9c-ddfa493849cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.161915 Aug 02 10:26:02.456187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 417/820] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:02.476589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.479297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.485365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.485810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.486572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.487004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.516692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47db3adf-f94a-4c41-b5ce-c85f280c2c2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Aug 02 10:26:02.517246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 404/821] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:02.793869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.794477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.800607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.801101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.801860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.802295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.891758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.892581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.898684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.899230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.900136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.900624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.929996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:02.938254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-240ada61-74b3-4e0f-aebb-18146d2be62b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.148105 Aug 02 10:26:02.938763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 418/822] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:03.033777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:03.041141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb2a9fe8-1eaa-442f-8751-c8081ab27aac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.153215 Aug 02 10:26:03.041695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 405/823] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:03.089438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.090047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.096090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.096535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.097292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.097726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.128085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.128533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.129000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:03.171998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:03.179421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-932f1be9-3028-4e33-8292-fce21d7036ae tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093819 Aug 02 10:26:03.179991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 419/824] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:03.407316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.409551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.416778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.417252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.417994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.418421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.447162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-75641684-3c1b-427e-b564-01be2f240514 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043847 Aug 02 10:26:03.447725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 406/825] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:03.477673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.478880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.485455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.485902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.486664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.487124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.529433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.532022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.538230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.538679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.539485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.539929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.570648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11367b79-37ec-4d45-b764-12b31aecc5e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 02 10:26:03.571229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 407/826] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:03.634067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:03.641961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a75fc66-e6f6-4b44-81b1-a14461203158 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.168195 Aug 02 10:26:03.642561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 420/827] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:03.960162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.960797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.967383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.967769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:03.968520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:03.968952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.061074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:04.061797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:04.068114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.068567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.069371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.069861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.100917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:04.108649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe111082-d645-4e9b-a806-23bcf36268e7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.152288 Aug 02 10:26:04.109216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 408/828] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:04.201849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:04.202606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:04.209020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.209469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.209576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:04.210530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.210972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.218389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82d0b2d4-f7b7-46bd-87e2-e788cf44fe53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.161131 Aug 02 10:26:04.218939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 421/829] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:04.246482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.246930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.247406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:04.291276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:04.298827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c1872620-433d-4261-8e6a-695ef26a2a39 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.101447 Aug 02 10:26:04.299455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 409/830] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:04 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:04.459625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:04.461890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:04.468188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.468683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.469393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.469873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.486282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:04.499501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c8293f66-fa07-4e00-8947-57ae598e99aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043890 Aug 02 10:26:04.500058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 422/831] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:04.582908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:04.585226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:04.591807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.592258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.593024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.593492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.626755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb36a42d-eb2f-4af1-a67a-5cccf3c562d0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Aug 02 10:26:04.627352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 410/832] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:04.664347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:04.664986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:04.671366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.671811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.672761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.673003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.820576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:04.829770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c9fecc4-5a63-428f-b84c-b8e89933124b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.169602 Aug 02 10:26:04.830344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 423/833] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:05.130014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.130647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.136699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.137141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.137934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.138358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.240052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.240669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.246940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.247417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.248180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.248610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.270519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:05.278506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-48046e78-a563-453e-b594-53140b08b259 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.152578 Aug 02 10:26:05.279071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 411/834] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:05.319504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.320135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.326152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.326592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.327398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.327827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.359269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.359731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.360158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lazy-loading 'fault' on Instance uuid b253c788-4268-4547-9ab9-94a8e9a15d8e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:05.381761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:05.389896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e4a729f-c408-4645-a1f7-5a4c9a68b985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.153693 Aug 02 10:26:05.390472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 424/835] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:05.401314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1b0932111477caa21cd18270cd8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fc70abe3344813a5c0b831b68f7c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:05.408800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-206f3e57-0303-4416-b126-7ff71a05f006 tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 200 len: 1305 microversion: 2.1 time: 0.093470 Aug 02 10:26:05.409347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 412/836] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:05.513113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.515513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.522102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.522545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.523323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.523752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.553572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0c533aaa-89ce-4cb8-a28c-537650509b88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045466 Aug 02 10:26:05.554115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 425/837] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:05.639774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.641932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.648577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.649014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.649987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.651054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.703514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:05.720212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de9d970f-660a-48d0-aa0c-4e16b24a6642 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084608 Aug 02 10:26:05.720789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 413/838] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:05.852197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.852912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.859016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.859515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.860284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.860724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.028724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:06.039353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6ac17a8e-bdf2-416f-9629-d5ba5f07bbad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.190079 Aug 02 10:26:06.052772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 426/839] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:06.301752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.302374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.309835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.310284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.311050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.311524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.412010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.413226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.422487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.429542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.429542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.429542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.444682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:06.452205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2167e0fc-3085-4fee-a622-1fef4ffbd18b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.154447 Aug 02 10:26:06.453170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 414/840] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:06.457726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.458522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] [instance: b253c788-4268-4547-9ab9-94a8e9a15d8e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.464670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.465286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.466241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.466667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.481275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] HTTP exception thrown: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Request method failure captured: Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e HTTP/1.1 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PtoMU-pBY7n-RlOxwmxqPspSmlJeSXrcgIPGUrnH71Var2yNS7WRHoyjvQSh6BivLU3K_iZ3QzMOlyHhXxyxf-E1W35h0UtkKcLq890-gz1kJGqNDXdzO0MtCTYtN1uX4-CSo4-sL4JKr8MAPERE88jWTjN95b4AhqckCFX2kCLVhI Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: c8fc70abe3344813a5c0b831b68f7c71 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-246542953 Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:26:06.482955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8fc70abe3344813a5c0b831b68f7c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8fc70abe3344813a5c0b831b68f7c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8fc70abe3344813a5c0b831b68f7c71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8fc70abe3344813a5c0b831b68f7c71", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-246542953 Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: c8fc70abe3344813a5c0b831b68f7c71 Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-246542953 Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-246542953-project Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: e7f1b0932111477caa21cd18270cd8c5 Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-246542953-project Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. Aug 02 10:26:06.484399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'b253c788-4268-4547-9ab9-94a8e9a15d8e'} Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:06.485227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. Aug 02 10:26:06.486493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:26:06.489378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] Returning 404 to user: Instance b253c788-4268-4547-9ab9-94a8e9a15d8e could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:06.489378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb6fdc56-7e1a-487c-8140-d841c8bcb66c tempest-VolumesNegativeTest-246542953 tempest-VolumesNegativeTest-246542953-project] 10.222.0.49 "GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e" status: 404 len: 111 microversion: 2.1 time: 0.030086 Aug 02 10:26:06.489378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 415/841] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/b253c788-4268-4547-9ab9-94a8e9a15d8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:26:06.566682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.568986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.575578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.576032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.576775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:06.577260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.577260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.585257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1d1e7f2e-db4f-4526-a9db-d8a772aeaa1f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.177042 Aug 02 10:26:06.587218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 427/842] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:06.616712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-152c0957-761f-4574-98ea-34c0179085bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054197 Aug 02 10:26:06.617260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 416/843] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:06.733529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.735677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.741602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.742043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.742865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.743762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.774675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de14fc4e-650f-4fe1-8f2a-7c90bd39861e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Aug 02 10:26:06.775777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 428/844] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:07.061962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.062565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.069064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.069531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.070309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.070740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.396868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:07.405199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd5a4cab-113d-47a1-a038-292eab853231 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1748 microversion: 2.1 time: 0.347253 Aug 02 10:26:07.405769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 417/845] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1748 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:07.474204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.474816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.481278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.481807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.482577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.483019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.607577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.615116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.630718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.631180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.631991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.632430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.740442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:07.747144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-37acc1c9-ca18-4e4e-9cc4-717e4e141a4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1369 microversion: 2.1 time: 0.276681 Aug 02 10:26:07.753409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 429/846] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:07.769205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.772432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.781369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.781932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.783543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.784061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.846848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:07.850192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e9fde53-c1d9-458c-8c3c-d7b9cf83146d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095291 Aug 02 10:26:07.850770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 430/847] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:07.857464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.860103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.860273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c9c6574-47b5-4187-9bd8-66a44c4f2aaf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.256453 Aug 02 10:26:07.867375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 418/848] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:07.880674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.881483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.882265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.882708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.914342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a027cf2-fc55-4a78-bce9-815dd561cd78 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062505 Aug 02 10:26:07.914894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 431/849] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:08.427394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.428115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.435792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.436230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.437191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.437625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.607364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:08.616534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd44c42c-3732-43ea-975f-098a9ce88a54 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.193261 Aug 02 10:26:08.617107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 419/850] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:08.769527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.770139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.776978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.777424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.778216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.778650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.863541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.865841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.872645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.873095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.873872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.874305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.905488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8c9239f4-6106-4bb3-bfda-d1de82cbd00c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046085 Aug 02 10:26:08.910113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 420/851] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:08.915359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.916556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.918214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:08.924271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.924655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.925429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.925951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.926216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-916fcf95-154c-4460-b295-def5a1cf1eed tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1563 microversion: 2.1 time: 0.160637 Aug 02 10:26:08.926779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 432/852] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:08.931778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.934110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.943736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.950485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.950485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.950485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.980234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-120bdcee-340d-4dac-87e8-56e8d375f7c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052161 Aug 02 10:26:08.980875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 433/853] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:08.985904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:08.986398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:08.996074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.996074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:08.996074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:08.996074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.078847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5e7ae395-e9b1-4bf4-8bfc-b7062a93a817 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096773 Aug 02 10:26:09.079474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 434/854] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:09.083947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:09.092745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-23713c7e-f160-4dcd-910e-16347c54841f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.181271 Aug 02 10:26:09.093320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 421/855] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:09.640838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:09.641567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:09.647914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.648446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.649214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.649647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.818358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:09.842698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5cba10ad-029f-4666-acac-ceddd0ae7817 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.205706 Aug 02 10:26:09.855249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 435/856] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:09.891928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-5f861490-e500-4e60-9fc3-f326284bd327 req-d2b0395d-b232-45b8-ad2c-7d95f669c9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "name": "network-vif-plugged", "status": "completed", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:09.891928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5f861490-e500-4e60-9fc3-f326284bd327 req-d2b0395d-b232-45b8-ad2c-7d95f669c9d8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.891928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5f861490-e500-4e60-9fc3-f326284bd327 req-d2b0395d-b232-45b8-ad2c-7d95f669c9d8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.904946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-5f861490-e500-4e60-9fc3-f326284bd327 req-d2b0395d-b232-45b8-ad2c-7d95f669c9d8 service nova] Creating event network-vif-plugged:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:26:09.910996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-5f861490-e500-4e60-9fc3-f326284bd327 req-d2b0395d-b232-45b8-ad2c-7d95f669c9d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042045 Aug 02 10:26:09.912277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 422/857] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:09.918135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:09.920476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:09.939005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.939005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.939005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.939282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.973519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9b022dcd-07b1-4c36-864b-519a42a798c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060278 Aug 02 10:26:09.974097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 436/858] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:09.994241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:09.996621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:10.003823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.004198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.005074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.005509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.039341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e167f1d-44fc-40c6-8948-5b059cc97548 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Aug 02 10:26:10.040382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 423/859] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:10.114045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:10.114859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:10.121371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.121948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.123138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.123659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.303793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:10.307526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-4c837573-7f4d-44f8-929f-2424a84f60de req-fea3d170-5d35-47e8-b7ff-59ffbf198f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10a2ee2-07a5-43d7-b3f5-8f382de25a9b", "tag": "7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:10.312816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b1a8ce57-2205-4bf7-b5a5-2bd53dd6e5d0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.202453 Aug 02 10:26:10.313614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 437/860] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:10.317934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4c837573-7f4d-44f8-929f-2424a84f60de req-fea3d170-5d35-47e8-b7ff-59ffbf198f6a service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.318475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4c837573-7f4d-44f8-929f-2424a84f60de req-fea3d170-5d35-47e8-b7ff-59ffbf198f6a service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.337530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-4c837573-7f4d-44f8-929f-2424a84f60de req-fea3d170-5d35-47e8-b7ff-59ffbf198f6a service nova] Creating event network-changed:7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8 for instance f10a2ee2-07a5-43d7-b3f5-8f382de25a9b on hv-cinder-84753 Aug 02 10:26:10.344693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-4c837573-7f4d-44f8-929f-2424a84f60de req-fea3d170-5d35-47e8-b7ff-59ffbf198f6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040524 Aug 02 10:26:10.345539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 424/861] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:10.872324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:10.873010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:10.881704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.882231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.883081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:10.883776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:10.987790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:10.990067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:10.999600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.000139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.004891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.004891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.033687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3da64c83-196e-40be-9371-4d783726efa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050904 Aug 02 10:26:11.034453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 425/862] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:11.046585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:11.052894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:11.055321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:11.055550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-22340203-fbf1-451c-afbb-b0b236f27748 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.194372 Aug 02 10:26:11.057081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 438/863] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:11.063700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.064327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.068793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.068793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.099653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-49079fb4-653c-4f57-9641-502dccd6b315 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050936 Aug 02 10:26:11.104850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 426/864] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:11.337349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:11.338499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:11.345739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.346432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.348680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:11.349312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:11.382523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:11.529640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:11.537670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c5b84601-d98a-40e6-819f-82a9a93880b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1260 microversion: 2.1 time: 0.204099 Aug 02 10:26:11.541655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 439/865] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:12.046371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:12.048547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:12.055048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.055529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.056272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.057192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.082809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:12.084411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:12.089153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5d6e30f3-41ea-49ea-a6e4-18f4351eacf3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046750 Aug 02 10:26:12.090180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 427/866] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:12.091964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.093630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.094451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.094887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.114204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:12.117385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:12.124273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.124725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.125498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.125937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.158778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e04f6c26-3882-4c75-b053-097fb3f67cbe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Aug 02 10:26:12.158778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 428/867] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:12 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:12.251047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:12.259294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6931e741-7288-441f-9543-54e36d041dee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.181116 Aug 02 10:26:12.259889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 440/868] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:12.562730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:12.563374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:12.569454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.569926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.570686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.571125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.706498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:12.714530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ff2bb950-e441-4e68-bdd8-c055198a4b3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1443 microversion: 2.1 time: 0.155679 Aug 02 10:26:12.715160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 429/869] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:12.736837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:12.737481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:12.743464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.744188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.744979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:12.745425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:12.879109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:12.886705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75a32cc0-cb12-402a-b361-140fe63d28eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1443 microversion: 2.1 time: 0.153715 Aug 02 10:26:12.887343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 441/870] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:13.101899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:13.104053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:13.110684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.111130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.111960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.112384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.142977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-95944ec9-541c-4f6d-af36-f6a698e7d457 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045252 Aug 02 10:26:13.143586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 430/871] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:13.170079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:13.172268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:13.178670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.179117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.179914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.180348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.212407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c61b743-ccbf-426c-a29f-e8bcff52057a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046368 Aug 02 10:26:13.213633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 442/872] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:13.282323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:13.283072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:13.290115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.290561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.291466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:13.291885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:13.437693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:13.445830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-554109e6-0a84-4761-b388-436ced4b2f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.168032 Aug 02 10:26:13.446402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 431/873] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:14.160010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:14.162154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:14.168824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.169269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.170029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.170464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.201688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4c7e06c-7abc-4458-853d-ac85f7429280 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045909 Aug 02 10:26:14.202258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 443/874] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:14.225366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:14.227521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:14.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.235099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.235896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.236326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.250601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:14.266176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d17a795e-3b86-4a6e-b8f3-04fa6da00af0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Aug 02 10:26:14.266729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 432/875] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:14.467753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:14.468364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:14.474360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.474804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.475697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.476080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.740576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:14.748881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5587f1b5-bc15-496e-a827-91e94705b06a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.284982 Aug 02 10:26:14.749569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 444/876] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:15.215963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:15.218318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:15.225139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.225616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.226382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.227049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.262457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-996baa98-3000-4a80-b0ba-50fb9aaca008 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051967 Aug 02 10:26:15.263326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 433/877] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:15.364794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-f71c4b22-3b0e-44da-b928-ce37ce7dd887 req-3e84ec4e-debc-4baa-966c-cdd390408dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:15.379313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f71c4b22-3b0e-44da-b928-ce37ce7dd887 req-3e84ec4e-debc-4baa-966c-cdd390408dd7 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.380040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f71c4b22-3b0e-44da-b928-ce37ce7dd887 req-3e84ec4e-debc-4baa-966c-cdd390408dd7 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.391924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-f71c4b22-3b0e-44da-b928-ce37ce7dd887 req-3e84ec4e-debc-4baa-966c-cdd390408dd7 service nova] Creating event network-changed:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:26:15.396832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-f71c4b22-3b0e-44da-b928-ce37ce7dd887 req-3e84ec4e-debc-4baa-966c-cdd390408dd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036465 Aug 02 10:26:15.397814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 434/878] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:15.410400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:15.413345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:15.425805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.425805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.425805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.425805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.454161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4f7ed0b9-081d-4301-9fd5-1552586452c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179758 Aug 02 10:26:15.455528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 445/879] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:15.772460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:15.773170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:15.780139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.780851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.781618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.782045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.274763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:16.278193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:16.279449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:16.285761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.286436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.287396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.287831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.287974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-51a1e389-69e5-4dc2-b650-f374d6fe9b97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.519892 Aug 02 10:26:16.288493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 435/880] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:16.318396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1f2ad46e-7bfd-4ab3-99dc-3842a6f1f379 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047716 Aug 02 10:26:16.319003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 446/881] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:16.466994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:16.469190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:16.475244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.475818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.476486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.476912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.506706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b7b8368-c2ac-40b9-bbc2-5cf4886ddb67 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Aug 02 10:26:16.507421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 436/882] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:17.309336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:17.309977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:17.316554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.317004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.317771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.318204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.331500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:17.333871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:17.340930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.341368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.342124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.342554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.372496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3563433-3f2e-4e30-b5b5-aa610d0644ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Aug 02 10:26:17.373061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 437/883] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:17.467620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:17.475905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2137168f-58e6-44d3-a724-72622c23d8f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1753 microversion: 2.1 time: 0.170272 Aug 02 10:26:17.476428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 447/884] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:17.519560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:17.521728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:17.528419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.528863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.529627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.530062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.559438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-57bee274-d596-4832-bd40-f41458dcb831 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Aug 02 10:26:17.559987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 438/885] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:18.386285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:18.388450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:18.395046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.395551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.396313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.396753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.425755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a90cb199-5ef1-4409-a498-5325e4a6b01e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043646 Aug 02 10:26:18.426309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 448/886] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:18.498712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:18.499356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:18.505891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.506335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.507082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.507536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.572006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:18.574254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:18.580359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.580774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.581550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.581988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.612510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aafb855b-67fe-43f1-994d-8a278a1c03b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Aug 02 10:26:18.613781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 449/887] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:18.651764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:18.659861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac0d6dfc-1fd9-4b51-8960-e903630be8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1756 microversion: 2.1 time: 0.165954 Aug 02 10:26:18.660430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 439/888] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:19.540464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:19.542707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:19.549120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.549571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.550332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.550771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.580612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f62e74a0-0757-4b79-b145-9d2cffadea06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146147 Aug 02 10:26:19.581158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 450/889] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:19.625465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:19.627648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:19.634350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.636473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.637258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.637697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.666129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc8f509e-6e44-4511-82f9-ee831ed7a230 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Aug 02 10:26:19.666681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 440/890] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:20.593968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:20.596162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:20.602668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.603118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.603918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.604357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.633522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81600715-0682-4910-93a5-ea7053d79d68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043652 Aug 02 10:26:20.634096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 451/891] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:20.677983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:20.680187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:20.682780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:20.687519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.687960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.688706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.689133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.719669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee2e2d48-3fb2-46d3-a9ba-c15e18392814 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Aug 02 10:26:20.720218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 441/892] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:21.646687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:21.649034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:21.656101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.656541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.657327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.657758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.686496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc838119-98b4-4969-848c-f45bcc2fa750 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043790 Aug 02 10:26:21.687047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 452/893] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:21.732037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:21.734286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:21.741128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.741575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.742345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.742776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.770909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ae8ec500-e442-4812-8e0d-ce815824169d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Aug 02 10:26:21.771420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 442/894] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:22.698790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:22.700989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:22.707468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.707929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.708684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.709119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.740038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-10a5b667-ff82-49c9-aec6-1cc09fbb5df3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045854 Aug 02 10:26:22.740587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 453/895] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:22.784228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:22.786335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:22.793376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.793824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.794590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.795028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.825374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3fd7017e-7533-4c14-9c7d-519246d2c0a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Aug 02 10:26:22.826955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 443/896] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:23.753558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:23.755732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:23.762717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.763152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.763931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.764357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.793539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-db1dd3c6-8387-492f-971d-582fad50bfff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044078 Aug 02 10:26:23.794089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 454/897] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:23.839146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:23.841480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:23.847590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.848031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.848784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.849212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.881064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d828e1a-f54f-4f2b-bd95-e2f6f3467df5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Aug 02 10:26:23.881651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 444/898] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:24.805872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:24.808005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:24.814409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.814849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.815666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.816095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.844395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4e4d67ef-b5f2-46db-94a7-2d47faa72d71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Aug 02 10:26:24.844935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 455/899] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:24.894102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:24.896285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:24.903160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.903638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.904453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.904884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.085863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61e8a688-8255-4c56-bcab-299abed525a2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195641 Aug 02 10:26:25.086335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 445/900] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:25.857669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:25.859976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:25.866353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.866807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.867573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.868008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.872516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:25.897417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b0eef978-852f-4cef-bfc2-96c18811b582 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044234 Aug 02 10:26:25.897967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 456/901] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:26.098769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:26.100935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:26.108150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.108594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.109353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.109782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.139144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-17a7bddf-6a09-417c-9822-e92a1d4e16a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 02 10:26:26.139716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 446/902] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:26.910387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:26.912558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:26.919513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.920060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.920739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.921177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.950729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2e498b97-962d-4e37-932c-704569add921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044485 Aug 02 10:26:26.951308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 457/903] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:27.151237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:27.153390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:27.160030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.160530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.161241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.161787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.191552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b56fea05-ab35-4977-8af0-c6147cf977ca tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Aug 02 10:26:27.192337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 447/904] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:27.963967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:27.966022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:27.972596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.973049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.973821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.974256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.003276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dcaf0e85-98cc-40a3-93e2-bde5a0a085f0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043940 Aug 02 10:26:28.003832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 458/905] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:28.204151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:28.206341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:28.213032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.213482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.214290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.214682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.243838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f22ff97c-b4f2-4faf-ac7a-046cb4df00d6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Aug 02 10:26:28.245054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 448/906] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:29.016103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:29.018238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:29.025006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.026099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.026872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.027345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.058961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e4c30cf-cd5d-46a3-9bfd-e983ccaea74b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046879 Aug 02 10:26:29.059558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 459/907] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:29.257498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:29.260813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:29.267420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.267866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.268634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.269069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.293354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:29.297746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6eebd5a3-4516-4d69-898f-b44eb1d3ed81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Aug 02 10:26:29.298294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 449/908] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:30.071478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.073730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.080293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.080735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.081502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.081931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.111162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a9a8a3f7-a6c5-47e1-afc9-0cdc99d0cee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043716 Aug 02 10:26:30.111748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 460/909] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:30.310425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.312615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.319397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.319848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.320614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.321051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.350911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3a2f23f-6642-43cb-8501-0d7e2d7ae2c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 02 10:26:30.351423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 450/910] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:31.123570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:31.125699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:31.132124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.132563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.133314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.133741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.162768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-169c8357-0c4d-456a-8628-93fff08ee508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043524 Aug 02 10:26:31.163338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 461/911] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:31.363714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:31.365837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:31.373470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.373889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.374647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.375075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.405394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d125333-d1b2-424a-8375-ba96594e21fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 Aug 02 10:26:31.405953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 451/912] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:32.175384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:32.177481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:32.179911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=95 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:32.185283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.188926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.188926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.188926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.218372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1ccec14f-5a4e-43b8-af01-b23dc715ba98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047080 Aug 02 10:26:32.218974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 462/913] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:32.418656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:32.420809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:32.427461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.427855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.428619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.429057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.457454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6cd0f5df-5439-4bcf-b265-754570e4393b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Aug 02 10:26:32.458007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 452/914] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:33.231569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:33.233749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:33.240310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.240762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.241530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.242023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.271752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5d3edd32-7a1a-4d4f-98be-08f9212ffe55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044937 Aug 02 10:26:33.272305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 463/915] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:33.470510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:33.472640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:33.479305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.480432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.481244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.481753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.510798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a140aafb-b59d-4622-84a5-63eb905cc7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Aug 02 10:26:33.511590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 453/916] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:34.285422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:34.287636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:34.294802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.295273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.296033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.296464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.326177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d3bdee0a-81c8-48cc-81c9-6e95d2eb5bb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045076 Aug 02 10:26:34.326734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 464/917] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:34.522557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:34.545490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:34.545490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.545490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.545490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.546458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.562665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4ce41347-89ab-4bd2-92d6-def81b5619ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Aug 02 10:26:34.563233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 454/918] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:35.338267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:35.340419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:35.346987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.347468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.348225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.348661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.384708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-59bd33ae-494f-4748-90ab-3cbd8a2bc84d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050493 Aug 02 10:26:35.387091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 465/919] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:35.575299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:35.577472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:35.584350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.584796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.585567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.586034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.616236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e19c6fb9-9eca-43a4-82a4-559d229b5b1b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Aug 02 10:26:35.616702 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 455/920] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:36.397515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:36.399672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:36.406781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.407244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.407997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.408426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.437895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1aef96e-f47c-4ada-99d5-a6011f6054a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044369 Aug 02 10:26:36.438450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 466/921] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:36.629058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:36.631323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:36.637899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.638356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.639629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.640057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.670108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69ae0596-f42a-4a4b-b02a-ed59e9ca8247 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Aug 02 10:26:36.670595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 456/922] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:37.450501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:37.452695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:37.459241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.459697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.460465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.460901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.489752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-04c02501-179b-475f-8f43-9cb8c3b4d5d4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043319 Aug 02 10:26:37.490319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 467/923] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:37.682123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:37.684428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:37.690907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.691395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.692165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.692658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.721660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58a26681-749c-495d-a5c8-b52dfa23e36a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Aug 02 10:26:37.722126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 457/924] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:38.502667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:38.504842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:38.511615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.512310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.512877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.513380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.543719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-137aede7-7e3e-473f-b120-0552525d1763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045524 Aug 02 10:26:38.544273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 468/925] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:38.734153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:38.736317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:38.742878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.743360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.744166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.744599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.774356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-adfcc415-0e89-42c0-bbe0-265d1a4774db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Aug 02 10:26:38.774902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 458/926] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:39.558156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:39.560537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:39.567068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.567560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.568343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.568802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.599829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c70c691-6e4e-4da3-8ca5-ba67a68f174c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045579 Aug 02 10:26:39.600387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 469/927] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:39.787412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:39.789480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:39.796088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.796542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.797307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.797749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.825933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7fdd2ec5-5aa3-430c-8e75-68603381caa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042585 Aug 02 10:26:39.827499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 459/928] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:40.612729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:40.614857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:40.621808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.622254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.623019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.624135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.652416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81af5982-a8d6-4e17-87e7-e119ee881f77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Aug 02 10:26:40.652970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 470/929] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:40.839019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:40.841126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:40.848130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.848580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.849527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.849961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.880697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-068918c0-a202-4251-973c-b565f3f43eb5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Aug 02 10:26:40.896409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 460/930] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:41.665568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:41.667768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:41.674373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.674823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.675615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.676055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.705729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9b32bedb-41b9-4f26-8cdc-e52e5f3e61c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044295 Aug 02 10:26:41.706274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 471/931] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:41.911637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:41.913767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:41.920821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.921291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.922547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.922988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.952248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-52b4c440-c402-4475-95d7-6d66c3fa0929 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 02 10:26:41.952797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 461/932] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:42.718607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:42.721285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:42.727845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:42.728293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:42.729052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:42.729486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:42.754152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:42.758555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-902b498e-b4c8-439b-a118-f74152c4a9cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Aug 02 10:26:42.759105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 472/933] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:42.964645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:42.966787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:42.973452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:42.973840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:42.974608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:42.975042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:43.005088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c8712bb7-e653-4c1c-99cf-c706bfb129da tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Aug 02 10:26:43.005643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 462/934] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:43.772276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:43.774573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:43.781236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:43.781781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:43.782547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:43.783211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:43.812516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-638f858a-8da8-4b45-96f4-8716ca7c87a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044593 Aug 02 10:26:43.813576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 473/935] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:44.017635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:44.019824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:44.026462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:44.026833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:44.027654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:44.028083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:44.058864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a3e8ec9e-6564-45b4-bf93-3fb0d93b7bff tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 02 10:26:44.059452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 463/936] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:44.825724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:44.827908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:44.834679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:44.835123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:44.835908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:44.836343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:44.867002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ae3bface-60a4-491b-a1bd-208cf952733d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045292 Aug 02 10:26:44.867826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 474/937] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:45.072299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:45.074549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:45.081922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:45.082299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:45.083141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:45.083745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:45.114506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-54ee8ffa-3d60-4025-9e02-956c08a27921 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Aug 02 10:26:45.115068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 464/938] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:45.880489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:45.882627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:45.889550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:45.889998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:45.890777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:45.891280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:45.923430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-68cc567d-76db-4069-9371-70f8e088af4f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047090 Aug 02 10:26:45.924039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 475/939] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:46.127891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:46.130064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:46.136847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:46.137200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:46.137979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:46.138413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:46.168461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-554b0e7b-130f-40c0-9249-ca3f3348c663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Aug 02 10:26:46.169044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 465/940] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:46.936175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:46.938145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:46.944719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:46.945162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:46.945927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:46.946351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:46.977249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ae270dc1-0863-4688-b69c-433b4dcb012c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045197 Aug 02 10:26:46.977823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 476/941] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:47.181095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:47.183334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:47.190219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:47.190565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:47.191399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:47.191841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:47.206883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:47.223519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a25d9bf6-8561-4ac7-a858-5b26e8ff4611 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Aug 02 10:26:47.224088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 466/942] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:47.991473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:47.993633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:48.001429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:48.001866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:48.002636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:48.003066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:48.034111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80b05a3a-f755-4d21-a6b3-979ed467f284 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046852 Aug 02 10:26:48.034673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 477/943] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:48.236610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:48.238774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:48.245917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:48.246283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:48.247092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:48.247547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:48.277707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2f0f7377-5757-4208-889c-a4cd4f2b097a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Aug 02 10:26:48.278270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 467/944] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:49.046632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:49.048845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:49.055620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:49.056071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:49.056853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:49.057293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:49.087851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e54735da-f80c-4921-a63b-49e55f05aff3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045258 Aug 02 10:26:49.088415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 478/945] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:49.290310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:49.292602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:49.299697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:49.300156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:49.300937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:49.301376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:49.331106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3cb8eb4-cbfb-42fb-87ba-dab1996969d1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Aug 02 10:26:49.331704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 468/946] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:50.100763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:50.102952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:50.109455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:50.110492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:50.111285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:50.111728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:50.140540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1dcf0a0a-939a-43fe-af22-9b63cf2fcf57 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043820 Aug 02 10:26:50.141092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 479/947] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:50.346256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:50.349423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:50.356958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:50.357409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:50.359020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:50.360541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:50.391967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9ab948ac-349f-4a01-9f9a-afb12bf8c992 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051890 Aug 02 10:26:50.392513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 469/948] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:51.153542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:51.155849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:51.162436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:51.163855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:51.163855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:51.164192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:51.193828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-00ce1232-cd05-4cbf-8b2a-dbd199b4d06b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044326 Aug 02 10:26:51.194468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 480/949] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:51.403822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:51.405986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:51.412602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:51.413041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:51.413794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:51.414222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:51.443959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-30485fad-4114-41b4-97ed-9e3f6daf16d8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Aug 02 10:26:51.447262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 470/950] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:52.206324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:52.208641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:52.215301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:52.215753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:52.216515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:52.216946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:52.246594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2454dac2-d679-49ed-870c-c57f31f1b7e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Aug 02 10:26:52.247145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 481/951] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:52.456882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:52.458917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:52.461329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=60 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:52.466081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:52.466523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:52.467313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:52.467747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:52.497332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d6f3f350-f4ab-4301-b384-48c855b0090a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Aug 02 10:26:52.497886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 471/952] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:53.258181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:53.260479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:53.267114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:53.267588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:53.268339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:53.268791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:53.297803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-94dfc18a-3e3e-49da-875e-2870eb9329b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043141 Aug 02 10:26:53.298361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 482/953] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:53.510182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:53.512291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:53.523557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:53.524001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:53.524760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:53.528402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:53.557381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-196c3f84-b803-433d-b595-400c00012e14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Aug 02 10:26:53.557937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 472/954] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:54.309990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:54.312261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:54.319372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.319833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:54.320596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.321033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:54.352115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1b2a893e-c611-4120-9be8-b4a0481fe362 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046160 Aug 02 10:26:54.352680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 483/955] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:54.570908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:54.573044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:54.579158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.579640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:54.580410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.580888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:54.611720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69f316bf-5f3f-4716-9bbf-cae7f21b7f88 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Aug 02 10:26:54.612336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 473/956] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:54.794038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b59196b3-b595-48c9-86b9-966f71a19f40"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:54.796398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:54.803274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.803734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:54.804512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:54.804951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:55.366015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:55.368300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:55.374591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:55.375032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:55.375821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:55.376258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:55.407087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d507170f-1527-4027-9d9d-61433ef93615 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045353 Aug 02 10:26:55.407698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 474/957] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:26:55.603194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-921a9928-b2eb-4c18-a6e0-cda2cc7a147c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "POST /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813203 Aug 02 10:26:55.603835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 484/958] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:26:54 2022] POST /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:55.625192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:55.628030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:55.634090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:55.634540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:55.635385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:55.635821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:55.671323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cfdc6fe4-8cd8-4eb0-95d7-02159d50a41b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050880 Aug 02 10:26:55.671882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 475/959] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:56.422345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:56.425242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:56.431651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:56.432110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:56.432881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:56.433320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:56.462277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0fd96876-c134-47e9-92de-f4b0ea60d0e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044916 Aug 02 10:26:56.462860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 485/960] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:56.683021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:56.685312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:56.692111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:56.692549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:56.693309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:56.694463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:56.724778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61e5f8f6-594c-40df-a1dc-fc220388df36 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Aug 02 10:26:56.725321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 476/961] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:57.474659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:57.476816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:57.483269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:57.483711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:57.484462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:57.484905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:57.515809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-72efd181-a23d-4edc-bc45-949d8b0f706d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045095 Aug 02 10:26:57.516371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 486/962] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:57.736629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:57.739351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:57.746198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:57.746643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:57.747464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:57.747936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:57.779092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4bd08b33-cedb-4ccd-939c-8627cd2e9472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046371 Aug 02 10:26:57.779684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 477/963] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:58.528504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:58.530690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:58.537422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:58.537873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:58.538630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:58.539131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:58.569800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-51052bd1-bea3-475a-8f5f-b820f108766f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Aug 02 10:26:58.570360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 487/964] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:58.790572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:58.792798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:58.799869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:58.800313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:58.801115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:58.801547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:58.834546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2afb18b0-2b4f-4189-85af-e454ab051d4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 Aug 02 10:26:58.835058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 478/965] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:59.583231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:59.585428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:59.592125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:59.592567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:59.593407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:59.593846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:59.597569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:59.624049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6052b019-10b4-41d0-8c30-9f986a482956 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Aug 02 10:26:59.624600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 488/966] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:26:59.846862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:59.849661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:59.856277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:59.856945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:59.857720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:59.858152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:59.887436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f661728c-d855-462e-ae46-eb4a4e2d9cc7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 02 10:26:59.887993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 479/967] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:26:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:00.636391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:00.638514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:00.646451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.646899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.647728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.648164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.679524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac8dcc38-ed46-4416-9f1e-49c9b417f9dc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047537 Aug 02 10:27:00.680116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 489/968] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:00.734040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-113218328"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:27:00.734564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:00.740724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.742892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.742892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.742892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.872094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.network.security_group_api [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Removing security group 17415122-eab8-4615-9e16-8a53299f7947 from port c4f3f335-8942-45b4-8620-77369a2b71e5 Aug 02 10:27:00.901056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:00.903246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:00.909984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.910357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.911259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:00.911716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:00.943955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1bbbf17d-cccd-44c1-8c41-f6969ec01a0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Aug 02 10:27:00.944716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 490/969] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:01.256305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b27448f-f5ed-4a59-88f7-686ed4288572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action" status: 202 len: 0 microversion: 2.1 time: 0.525187 Aug 02 10:27:01.256808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 480/970] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:27:00 2022] POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:27:01.369295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-7190ea8b-c720-4446-b98a-a6d78d736fed req-1d7817ef-727d-4c15-82df-f459431a1f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:27:01.381926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-7190ea8b-c720-4446-b98a-a6d78d736fed req-1d7817ef-727d-4c15-82df-f459431a1f93 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:01.382680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-7190ea8b-c720-4446-b98a-a6d78d736fed req-1d7817ef-727d-4c15-82df-f459431a1f93 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:01.394448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-7190ea8b-c720-4446-b98a-a6d78d736fed req-1d7817ef-727d-4c15-82df-f459431a1f93 service nova] Creating event network-changed:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:27:01.400245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-7190ea8b-c720-4446-b98a-a6d78d736fed req-1d7817ef-727d-4c15-82df-f459431a1f93 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139028 Aug 02 10:27:01.401436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 491/971] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:01.694400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:01.697417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:01.703938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:01.704472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:01.705622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:01.706168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:01.736754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-28a607b0-3ebf-4073-be5f-e6c4b7e9a588 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048163 Aug 02 10:27:01.737455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 481/972] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:01.956294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:01.959088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:01.966039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:01.967068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:01.967425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:01.967856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:02.000689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8dcf3dcc-6d6e-43af-9223-8217e80e088a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Aug 02 10:27:02.005493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 492/973] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:02.750481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:02.752728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:02.759873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:02.760315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:02.761072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:02.761503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:02.791403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ce02198-864c-4ab4-b03c-05ae8d35ae74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044841 Aug 02 10:27:02.808065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 482/974] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:02.848794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:02.849359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:02.851448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=62 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:02.856216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:02.856726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:02.857547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:02.858045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:02.938721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lazy-loading 'services' on Instance uuid 9fb7d6a1-2042-4138-86b7-fdfe501f1081 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:27:03.013368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:03.015954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:03.022621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.023070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.023883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.024407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.038627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:03.057048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-112def14-cbfb-4a67-8d8a-71e863cc2cc0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047720 Aug 02 10:27:03.057572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 483/975] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:03.170979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-07f30c3b-8039-4e16-b1fc-ac2c9cfee890 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af" status: 202 len: 0 microversion: 2.1 time: 0.326048 Aug 02 10:27:03.171586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 493/976] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:27:02 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:27:03.180218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:03.182403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:03.190663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.190663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.190663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.191161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.221016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b92051e8-7173-453e-a402-3c73251a9a32 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 02 10:27:03.221583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 484/977] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:03.417661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-0d47d12c-f287-4956-8cb0-bab129dc2ee7 req-402185dd-0021-47c8-baa4-c3f5941115b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:27:03.432166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-0d47d12c-f287-4956-8cb0-bab129dc2ee7 req-402185dd-0021-47c8-baa4-c3f5941115b9 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.432166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-0d47d12c-f287-4956-8cb0-bab129dc2ee7 req-402185dd-0021-47c8-baa4-c3f5941115b9 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.440525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-0d47d12c-f287-4956-8cb0-bab129dc2ee7 req-402185dd-0021-47c8-baa4-c3f5941115b9 service nova] Creating event network-changed:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:27:03.446207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-0d47d12c-f287-4956-8cb0-bab129dc2ee7 req-402185dd-0021-47c8-baa4-c3f5941115b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032836 Aug 02 10:27:03.447316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 494/978] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:03.804090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:03.806285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:03.819912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.820364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.821173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:03.821606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:03.858385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a3c83667-e8b8-4baa-8736-91c40f2c9450 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058319 Aug 02 10:27:03.859320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 485/979] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:04.071116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:04.073284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:04.079555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.079998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.080754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.081183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.110980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8ce99f59-d066-48c0-9e26-d4634c754fab tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Aug 02 10:27:04.111606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 495/980] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:04.233627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:04.235792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:04.242357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.242827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.243630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.244054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.272594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5caa9c04-3078-44fa-a631-e6cf5c84bba6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042976 Aug 02 10:27:04.273134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 486/981] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:04.871704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:04.873870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:04.880070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.880545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.881308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:04.881739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:04.910399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d203f7ac-86b5-4fad-a1c5-4782ee5c1272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043045 Aug 02 10:27:04.911600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 496/982] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:05.124590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:05.126707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:05.133513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.133982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.134761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.135226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.164777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-efad976f-3582-4a2c-8473-2514405ad03a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Aug 02 10:27:05.165335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 487/983] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:05.285083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:05.287303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:05.293841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.294291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.295070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.295521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.329843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3a2e05c-0985-4e67-a187-424d88399c56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Aug 02 10:27:05.330448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 497/984] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:05.923875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:05.925933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:05.932589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.933034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.933793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:05.934228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:05.963434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8b4fcaa3-e856-46e9-b144-2b34c6ed0d8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043718 Aug 02 10:27:05.963980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 488/985] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:06.179890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:06.183630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:06.190106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.190558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:06.191373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.191806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:06.222835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d1f7ae5e-6532-4a67-80d2-73b2e62c744d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Aug 02 10:27:06.223934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 498/986] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:06.342892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:06.345096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:06.352158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.352600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:06.353363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.353796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:06.384720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-33c8bee5-3082-49c9-8fd0-5b942d5d7d08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Aug 02 10:27:06.385286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 489/987] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:06.977750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:06.979891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:06.986475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.986924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:06.987720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:06.988159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:07.017940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e52991bc-18c6-4ede-a0a3-2303444501ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045150 Aug 02 10:27:07.018511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 499/988] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:07.235745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:07.237803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:07.244403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:07.244845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:07.246076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:07.246514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:07.275433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-541ac0fd-f1f1-41fd-96af-373fb9f650a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Aug 02 10:27:07.275983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 490/989] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:07.397128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:07.399406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:07.405479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:07.405933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:07.406699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:07.407139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:07.436360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6ac3a64-bffa-4fad-9f27-aec75817b2c7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 02 10:27:07.436917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 500/990] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:08.031544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:08.033718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:08.040818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.041256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.042010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.042439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.070924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe250293-8d8a-485b-81e5-1799469312bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043549 Aug 02 10:27:08.071497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 491/991] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:08.288333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:08.290436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:08.297054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.297503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.298301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.298706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.328148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4e98304a-2a75-4504-8dc6-a9b1da84c7ec tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 02 10:27:08.328712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 501/992] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:08.449668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:08.451858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:08.458518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.458961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.459842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:08.460364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:08.490834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b5241d39-4aa0-401c-85d2-1a71761e92ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Aug 02 10:27:08.491441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 492/993] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:09.083516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:09.085678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:09.092102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.092565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.093343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.093783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.124065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ada39eaa-5894-4388-a08b-cbe7cc3cc9d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044617 Aug 02 10:27:09.124632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 502/994] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:09.341507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:09.343757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:09.350773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.351239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.352099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.352538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.382702 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bc670c3b-c41c-4b6d-af7f-9e0bbc93fac8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Aug 02 10:27:09.383283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 493/995] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:09.505909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:09.508118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:09.514720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.515071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.515877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:09.516305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:09.548162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-744a9a41-070c-4e60-8225-c0028eceb77e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 Aug 02 10:27:09.548722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 503/996] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:10.136981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:10.139057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:10.145234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.145672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.146459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.146882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.174889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-caddeea9-a0da-4b77-8aed-f5715efdc046 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042046 Aug 02 10:27:10.175468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 494/997] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:10.396245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:10.398323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:10.404442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.404889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.405655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.406088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.436714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2e6ffa54-36b1-4efb-9a51-d1816c8d3aad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Aug 02 10:27:10.437317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 504/998] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:10.561125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:10.563419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:10.571775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.572349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.573126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:10.573564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:10.604774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d74c2944-7ffe-456c-a224-3c47a687c61b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Aug 02 10:27:10.605440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 495/999] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:11.188019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:11.190154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:11.197769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.198339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.199116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.199637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.217001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:11.229466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cae17ae6-3fb2-4d34-9559-714051e1118b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Aug 02 10:27:11.230014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 505/1000] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:11.449308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:11.451386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:11.457773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.458222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.459151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.459617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.490397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4eaa8ca-0c16-4101-b7a2-7c1c9be53e06 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Aug 02 10:27:11.490947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 496/1001] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:11.618274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:11.620486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:11.627309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.627748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.628505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:11.628936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:11.657256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ae87bd24-a368-481c-b53f-5816374cb109 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Aug 02 10:27:11.657844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 506/1002] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:12.242146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:12.244263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:12.251154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.251636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.252402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.252856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.283682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6c69b19f-fd75-428a-b9c8-e16f3daef0c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045593 Aug 02 10:27:12.284238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 497/1003] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:12.503028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:12.505890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:12.513310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.513757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.514562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.514995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.544453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dd560582-567f-4d6e-8d2c-17cec72fdf7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045358 Aug 02 10:27:12.545015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 507/1004] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:12 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:12.670413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:12.672610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:12.679126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.679607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.680370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:12.680812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:12.709891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f919e984-9a9d-4c9e-8815-86e81fd401a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Aug 02 10:27:12.710598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 498/1005] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:13.297100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:13.299276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:13.305389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.305887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.306647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.307081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.335788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-32d586c5-fd17-4d94-b960-432fd5ee775e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043511 Aug 02 10:27:13.336345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 508/1006] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:13.557131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:13.559273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:13.565807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.566251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.567530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.567967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.597897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-38eeae13-43d8-4b73-948a-b315c19040fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Aug 02 10:27:13.598458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 499/1007] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:13.722557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:13.724825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:13.731336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.731779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.732542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:13.732964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:13.761950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ebf06ed3-ac6e-4cd9-8639-7af1d40ff5e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Aug 02 10:27:13.762516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 509/1008] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:14.347590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:14.350272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:14.356324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.356764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.357538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.357963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.360289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:14.387583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad71770b-5d72-4055-af9b-4e836dcef336 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044031 Aug 02 10:27:14.388139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 500/1009] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:14.609215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:14.611433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:14.618023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.618464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.619250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.619768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.651035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c8b31f70-dd21-4ea3-8df7-a0eef8336fe2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Aug 02 10:27:14.651626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 510/1010] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:14.774668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:14.776904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:14.783986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.784434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.785204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:14.786315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:14.815089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4001846-9d13-4d04-b865-b257d37fadd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Aug 02 10:27:14.815746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 501/1011] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:15.400161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:15.402301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:15.409064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.409515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.410288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.410732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.440088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ffbcdcd1-23dd-41d4-b070-ad802ee97ed0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044002 Aug 02 10:27:15.440638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 511/1012] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:15.663504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:15.665636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:15.671616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.672063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.672818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.673253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.702291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a70374ea-ce3d-4685-be8d-0802cfb3cfc8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Aug 02 10:27:15.702834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 502/1013] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:15.827511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:15.829724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:15.835779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.836221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.836969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:15.837398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:15.868852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ae8fcfd6-9b33-4629-ad14-f65d29871657 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Aug 02 10:27:15.869412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 512/1014] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:16.454216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:16.456323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:16.463364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.463810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.464593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.465041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.494789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-775d53ad-7f05-4e23-a78d-d0ff32cef484 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044602 Aug 02 10:27:16.495369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 503/1015] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:16.714418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:16.716532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:16.723768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.724076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.724826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.725258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.754366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c7415d2d-eece-49f5-9c8a-831ee124c263 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Aug 02 10:27:16.754906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 513/1016] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:16.881836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:16.884145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:16.890204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.890654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.891446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:16.891888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:16.929200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f057f6fa-aaed-445e-b9ed-8634da0163e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051302 Aug 02 10:27:16.929762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 504/1017] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:17.512211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:17.514250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:17.521226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.521678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.522451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.522927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.556582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a765e4be-1d0a-4f9c-9ab2-10c83cae110a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052561 Aug 02 10:27:17.557267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 514/1018] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:17.766280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:17.768372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:17.774975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.775448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.776211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.776649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.806677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9ff3922-f264-409d-b1a0-01cc4f69e8c9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Aug 02 10:27:17.807241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 505/1019] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:17.941383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:17.944328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:17.950703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.951144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.951977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:17.952400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:17.980049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-afb452ad-bc80-4a54-9034-379d229875dc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Aug 02 10:27:17.980642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 515/1020] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:18.570652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:18.572928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:18.579199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:18.579671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:18.580440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:18.580878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:18.610512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-005b2de4-6457-4170-aca9-3ed5989838b5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044282 Aug 02 10:27:18.611071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 506/1021] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:18.818222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:18.820354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:18.826328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:18.826766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:18.827553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:18.827983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:18.862732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ccd6ac6d-6fc6-49e5-8b7e-3ec8ef804013 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048598 Aug 02 10:27:18.863312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 516/1022] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:18.992261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:18.994407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:19.001298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.001749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.002517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.002957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.033745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bc31edbe-8ac4-4427-99e9-caaee4fd3ea3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 02 10:27:19.034295 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 507/1023] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:19.624870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:19.627020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:19.633914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.634370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.635138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.635600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.665660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d49ebd26-8347-4b92-b496-f835bdf7619a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Aug 02 10:27:19.666222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 517/1024] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:19.876377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:19.878417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:19.885114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.885552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.886337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:19.886768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:19.916134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-474d4898-4b65-4dd5-a6d8-98c303543dce tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 02 10:27:19.916684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 508/1025] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:20.046619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:20.048857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:20.055530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.055977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.056756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.057190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.085989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1bdd913a-85f9-4891-bb14-bcfe3db8e699 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Aug 02 10:27:20.086546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 518/1026] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:20.678850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:20.681029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:20.687563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.688012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.688776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.689262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.718797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dbd8adef-7c01-4fe5-9121-62605bff30ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Aug 02 10:27:20.719368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 509/1027] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:20.929081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:20.931540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:20.938001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.939856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.939856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:20.939856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:20.973525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-074f96a2-df0e-4985-ad8f-bb04c38f1c4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049054 Aug 02 10:27:20.974606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 519/1028] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:21.097982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:21.100669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:21.106670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.107111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:21.107902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.108344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:21.137974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22d4f981-ae82-4123-918a-e83605ef4128 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Aug 02 10:27:21.138534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 510/1029] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:21.731383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:21.733423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:21.739507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.739989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:21.740805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.741239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:21.770122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f97fa123-bcac-414c-8c0b-8f23d3df28cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042832 Aug 02 10:27:21.770672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 520/1030] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:21.986985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:21.989090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:21.996945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.997421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:21.998179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:21.998610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:22.033834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f24f56f9-a49a-4541-9100-5cd4bf96e8a6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050973 Aug 02 10:27:22.034386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 511/1031] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:22.151390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:22.153924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:22.160778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:22.161226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:22.161996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:22.162434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:22.197472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1c70a4d0-2ce8-44e3-8c22-cff4ab485881 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051096 Aug 02 10:27:22.198050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 521/1032] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:22.783550 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:22.785807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:22.792000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:22.792438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:22.793191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:22.793617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:22.822797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-08942e95-2aa8-4d98-b71f-1853cc5784f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043275 Aug 02 10:27:22.823388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 512/1033] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:23.046180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:23.048283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:23.054891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.055378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.056138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.056572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.060152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:23.085545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c0b501a7-2164-44d4-92a9-848b19e0c7cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Aug 02 10:27:23.086085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 522/1034] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:23.210049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:23.212258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:23.219108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.219601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.220387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.220813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.250494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a920aba8-926f-410a-8929-2a340ad9faed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Aug 02 10:27:23.251041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 513/1035] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:23.835473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:23.837658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:23.844635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.845064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.845817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:23.846247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:23.875996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-79a9ea39-d08a-4fed-ae3e-189a6501d076 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044624 Aug 02 10:27:23.876550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 523/1036] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:24.098338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:24.101013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:24.102864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=86 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:24.107711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.108317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.109084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.109515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.139367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d8db2c89-f029-4c62-b575-2dd213ab2714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Aug 02 10:27:24.139978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 514/1037] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:24.265845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:24.265845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:24.270548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.271058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.271803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.272235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.301488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ab72ea44-e7a4-457d-8cd6-c038c381e0d2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Aug 02 10:27:24.302039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 524/1038] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:24.889188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:24.891409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:24.897566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.898019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.898785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:24.899248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:24.929450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e070e5e-b602-4980-b9d9-d0a5f18eccc0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 02 10:27:24.930014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 515/1039] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:25.151515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:25.153614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:25.159996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.160434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.161187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.161612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.190591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b81554d0-31a8-4ea1-8290-67bf96189427 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Aug 02 10:27:25.191167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 525/1040] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:25.314357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:25.316566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:25.323709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.324161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.324941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.325375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.351390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:25.356182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b61da0a9-0265-45f7-a020-4f7a6b63c185 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Aug 02 10:27:25.356765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 516/1041] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:25.942043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:25.944749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:25.950927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.951448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.952224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:25.952663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:25.981311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b4debd17-3ec4-4f67-890f-d4d81d4d0c9f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043453 Aug 02 10:27:25.981875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 526/1042] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:26.203225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:26.205321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:26.211794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:26.212241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:26.213001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:26.213436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:26.243109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56fa73cd-ec96-468f-a77c-ae995404ae44 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 02 10:27:26.243688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 517/1043] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:26.369686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:26.372191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:26.378931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:26.379404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:26.380449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:26.380891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:26.409956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55ad865a-e639-4b17-a6ad-18a3345d2d85 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Aug 02 10:27:26.410502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 527/1044] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:26.993832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:26.996052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:27.002980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.003507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.004277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.004715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.035131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be35654c-bb13-4677-a88e-994143a292a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Aug 02 10:27:27.035706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 518/1045] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:27.255906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:27.258572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:27.264677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.265122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.265887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.266321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.296121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-522d3d68-5641-47e4-af9b-b608fa16d051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Aug 02 10:27:27.296683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 528/1046] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:27.421995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:27.424293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:27.431568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.431568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.432663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:27.433391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:27.465293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cdca164d-0c45-4161-a1e0-41b85163aef7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Aug 02 10:27:27.465846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 519/1047] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:28.047668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:28.049852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:28.056867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.057310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.058065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.058496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.087273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55f69feb-5e2c-4de4-89e7-c299a1cc6204 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043627 Aug 02 10:27:28.087821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 529/1048] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:28.308754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:28.310866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:28.317448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.317916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.318675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.319119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.348079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-618f451f-5403-4063-81b5-3b832df48051 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Aug 02 10:27:28.348626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 520/1049] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:28.477903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:28.479776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:28.485811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.486334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.487113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:28.487572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:28.518505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cda01035-0b7f-4566-b928-948c1b84e903 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Aug 02 10:27:28.519066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 530/1050] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:29.099717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:29.101838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:29.107948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.108385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.109148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.109582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.139486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35227b6f-b19f-49f8-994c-18853adc9cd1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043771 Aug 02 10:27:29.140028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 521/1051] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:29.361677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:29.363792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:29.371008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.371505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.372498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.373009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.401303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9abca071-132e-40f1-ab82-8fe7c2226c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 02 10:27:29.401899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 531/1052] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:29.529945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:29.532430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:29.538544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.538995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.540319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:29.540753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:29.572188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ae998526-e473-48c6-8e31-0cdf37591713 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Aug 02 10:27:29.572779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 522/1053] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:30.152780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:30.154917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:30.161007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.161452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.162209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.162642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.191597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-44c2e800-5d58-4169-b981-bc70b18f5c8e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043472 Aug 02 10:27:30.192164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 532/1054] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:30.415010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:30.417090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:30.423285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.423728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.424482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.424911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.454796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2080718e-9c4d-4f8e-b8b8-37ef68361beb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Aug 02 10:27:30.455389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 523/1055] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:30.584496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:30.586852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:30.593530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.593979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.594754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:30.595210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:30.626158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88be4281-0586-4182-95a0-90195831408a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Aug 02 10:27:30.626865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 533/1056] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:31.204369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:31.206479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:31.213590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.214028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.214823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.215318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.244400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e8d862e-cadc-4346-8c44-b39010790282 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Aug 02 10:27:31.244947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 524/1057] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:31.467297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:31.469371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:31.475563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.476033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.476789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.477228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.640751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:31.643104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:31.649870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.651328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.652343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:31.654046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:31.662506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d9304df-4316-482a-a194-9185324f12bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200054 Aug 02 10:27:31.663451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 534/1058] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:31.700204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b25e206c-5dfd-458e-ac55-0712c21600ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065863 Aug 02 10:27:31.700753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 525/1059] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:32.257162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:32.259348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:32.265428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.265874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.266673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.267110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.296418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-38f8cd0e-7afc-4ece-9d48-51621a7a5f23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043305 Aug 02 10:27:32.296965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 535/1060] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:32.675091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:32.677307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:32.684500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.684946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.685720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.686157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.713925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:32.716496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:32.718603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b195e3c0-f7e4-48a3-9fe6-0a9f8f5a7194 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 Aug 02 10:27:32.719166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 526/1061] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:32.723297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.723596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.724368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:32.724797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:32.755590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-129a15b0-5f43-4666-bd3c-06be8e5a4115 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047079 Aug 02 10:27:32.756138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 536/1062] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:33.309152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:33.311334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:33.317481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.317925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.318678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.319109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.349750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b1347c09-76ab-4d5a-bd96-2d47edfcdd02 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044510 Aug 02 10:27:33.350303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 527/1063] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:33.730709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:33.732867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:33.736218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=88 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:33.739706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.740155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.740933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.741373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.770941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:33.774014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:33.774309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1ed9516-35ba-4c1e-bb89-8478dfb8c65e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Aug 02 10:27:33.779612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 537/1064] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:33.788076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.788894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.789720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:33.790800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:33.828934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2db8dc9f-43c9-4a52-b95b-21dd2a17b52c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064333 Aug 02 10:27:33.829495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 528/1065] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:34.362651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:34.364840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:34.371668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.372370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.373166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.373599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.398650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:34.403048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c572d8ba-15ed-4cea-a5b1-2ae2e6083bcb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044905 Aug 02 10:27:34.403732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 538/1066] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:34.787763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:34.789928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:34.797416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.797865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.798636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.799074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.828568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db5c2c6a-7ace-494b-ad50-998a1679638b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Aug 02 10:27:34.829316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 529/1067] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:34.842912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:34.845181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:34.851993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.852433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.853192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:34.853623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:34.886356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-25a9bc96-3a65-42c2-97db-5a63ff1d69f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047970 Aug 02 10:27:34.886871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 539/1068] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:35.415806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:35.418024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:35.424298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.424737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.425539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.426001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.454915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6ea18660-9c9a-4490-bf37-6f57e23c0f0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043230 Aug 02 10:27:35.455504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 530/1069] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:35.841155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:35.843313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:35.849852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.850287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.851044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.851496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.880187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-494fba36-399d-4635-b981-30e90f74b723 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043040 Aug 02 10:27:35.880739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 540/1070] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:35.906319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:35.908535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:35.915126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.915605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.916870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:35.917306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:35.946486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9b610d66-8606-41e6-ae5d-8d5077d2e8b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Aug 02 10:27:35.947266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 531/1071] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:36.467947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:36.470062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:36.476313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.476761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:36.477521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.477956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:36.507903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93cf7f8b-c422-4e5b-9935-15dcf2323373 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044494 Aug 02 10:27:36.508451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 541/1072] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:36.892674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:36.894878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:36.901125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.901589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:36.902359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.902786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:36.932413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8100f4e3-6805-46b9-a294-2f49df335cfc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 02 10:27:36.933737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 532/1073] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:36.957828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:36.960217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:36.966876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.967335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:36.968172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:36.968636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:37.001584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9538b707-f902-4b54-9554-fbb920ecc42c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047467 Aug 02 10:27:37.002152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 542/1074] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:37.520368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:37.522511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:37.529490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:37.536594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:37.536594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:37.536594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:37.545548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:37.560627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-00dd9f11-9641-4c18-b8b6-c5d2421cc276 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044425 Aug 02 10:27:37.561180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 533/1075] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:37.945711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:37.947752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:37.954506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:37.955250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:37.956077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:37.956506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:37.986084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e58bb89a-e67c-44a3-8292-fa121a847dfe tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Aug 02 10:27:37.986747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 543/1076] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:38.013816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:38.017553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:38.024528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:38.024999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:38.025737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:38.026172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:38.056142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-780904a9-d4e8-444f-b5d8-f456d5cbafa1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046410 Aug 02 10:27:38.056733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 534/1077] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:38.573598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:38.576435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:38.583468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:38.583917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:38.584739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:38.585167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:38.618060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b9473cad-1be1-49ba-96ef-ee6fd3101992 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048631 Aug 02 10:27:38.618636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 544/1078] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:38.998884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:39.001125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:39.007594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.007775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.008566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.008998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.040022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2252a9fa-d7ca-4a63-b89c-3f6d9b4b200c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Aug 02 10:27:39.040736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 535/1079] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:39.068275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:39.070400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:39.077448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.077939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.078715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.079156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.110294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2c00e72-d092-4198-9d8d-f71c5d49e569 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045744 Aug 02 10:27:39.110616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 545/1080] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:39.632060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:39.634240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:39.640393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.640840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.641600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:39.642042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:39.671346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a99c43b7-ff4c-403a-a9f7-af965ce3561a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043360 Aug 02 10:27:39.671908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 536/1081] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:40.052803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:40.054936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:40.061163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.061611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.062379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.062812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.092222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a531e248-6a61-4ff2-92dc-900efdec7525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 02 10:27:40.092862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 546/1082] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:40.122208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:40.124642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:40.131160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.131641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.132494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.132932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.164232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7056c0dc-d5ff-4b1f-b54a-47fbb1e168a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 02 10:27:40.164987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 537/1083] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:40.684297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:40.686460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:40.692564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.693011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.693781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:40.694216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:40.723922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e2f20966-bb8c-471c-b801-53bd414f5bd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043890 Aug 02 10:27:40.724470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 547/1084] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:41.105400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:41.107586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:41.113721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.114170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.114931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.115411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.148078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d9c97604-f8e2-4b04-9873-f7d160a98c43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047068 Aug 02 10:27:41.148813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 538/1085] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:41.177318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:41.179667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:41.187613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.188070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.188847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.189279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.235556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2abb6401-3da0-4ca1-9464-55a4ad2773a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057904 Aug 02 10:27:41.235556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 548/1086] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:41.737044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:41.739177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:41.745311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.745748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.746497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:41.746921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:41.782219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1d5aace-17bc-4440-811f-08480a00669e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049180 Aug 02 10:27:41.782783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 539/1087] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:42.160041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:42.162163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:42.168766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.169208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.169982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.170472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.200101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-912d4360-27dd-451b-b419-695ab7a88b3c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Aug 02 10:27:42.200801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 549/1088] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:42.243130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:42.246341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:42.253566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.254016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.254813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.255288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.287522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c11c954b-c50b-4ad4-8e99-b9d00bde0cca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048243 Aug 02 10:27:42.288119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 540/1089] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:42.794710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:42.796902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:42.803060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.803543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.804337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:42.804919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:42.834125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cd4a14a-6d16-4004-9d06-39b621dc2d6f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043383 Aug 02 10:27:42.834671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 550/1090] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:43.212666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:43.215251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:43.221430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.221872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.222640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.223074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.253342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6e68274a-e4be-41f4-b0de-90a7118dd30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Aug 02 10:27:43.254000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 541/1091] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:43.300820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:43.302964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:43.309427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.309878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.310645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.311082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.341314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3cdd984a-de09-47ad-a419-9595813a5473 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 02 10:27:43.341864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 551/1092] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:43.846708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:43.848914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:43.855650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.856095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.856857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:43.857292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:43.886362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b142cfec-4a79-46c5-a002-1440a2929508 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043637 Aug 02 10:27:43.886928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 542/1093] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:44.266241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:44.268420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:44.274492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.274934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.275721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.276151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.305952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cc09edcc-790c-41ae-aa4d-794382232545 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Aug 02 10:27:44.306628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 552/1094] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:44.353649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:44.355811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:44.362486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.362932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.363717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.364147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.393925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4ecd9e0-fa22-4713-8b9d-5856a44d608e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 02 10:27:44.394627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 543/1095] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:44.898831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:44.901092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:44.907525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.907972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.908751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:44.909188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:44.939161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-abe00b9b-99fb-4392-a46d-dc4de9c1fafe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044330 Aug 02 10:27:44.939727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 553/1096] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:45.318400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:45.324545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:45.326603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.327053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.327858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.328300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.358159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e730b866-86c5-4f2f-88d4-91e4f4db9f3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Aug 02 10:27:45.359032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 544/1097] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:45.407030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:45.409402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:45.415972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.416416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.418057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.418229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.448587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e600b21e-a9ea-4819-8bb6-609a5e48fcd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Aug 02 10:27:45.453022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 554/1098] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:45.952063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:45.954163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:45.960723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.961170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.962072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:45.962514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:45.992667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-07b7b3e3-199f-4efa-864d-f40be74c6900 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044776 Aug 02 10:27:45.993223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 545/1099] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:46.372943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:46.375106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:46.381300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:46.381756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:46.382512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:46.382940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:46.399692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:46.412402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5cebf9e7-5b12-49d2-9496-187e683ecf07 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Aug 02 10:27:46.417397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 555/1100] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:46.461071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:46.463415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:46.470107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:46.470555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:46.471626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:46.472421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:46.506691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-afec73c0-4be4-419a-ad50-ae916b64a7cf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049642 Aug 02 10:27:46.507290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 546/1101] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:47.005793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:47.008038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:47.015251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.015597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.016359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.016795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.046281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-41a96319-1586-4fe9-a10f-5d97b8a3196f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044570 Aug 02 10:27:47.046819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 556/1102] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:47.428456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:47.430553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:47.437608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.438052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.438809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.439269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.468059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3f9d2e88-3482-4a01-b29b-13d06151776f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 02 10:27:47.468656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 547/1103] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:47.525252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:47.532769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:47.534059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.534252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.535008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:47.535486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:47.564671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b6bea79-b574-41ac-a729-f0d9728e8170 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 Aug 02 10:27:47.565242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 557/1104] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:48.058844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:48.061742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:48.067730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.068178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.068938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.069411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.097243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1cec3306-32b3-4b70-a957-8cdefa705da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042378 Aug 02 10:27:48.097789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 548/1105] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:48.480665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:48.484080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:48.493293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.494091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.495477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.496246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.529155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4763bb04-004f-41ca-b71b-8ef7abae3d9b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052438 Aug 02 10:27:48.531661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 558/1106] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:48.577977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:48.579720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:48.586167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.586612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.587462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:48.587901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:48.617379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61f2199d-6e6b-4d2e-bc5f-32c9d5b04cf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 02 10:27:48.617953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 549/1107] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:49.110448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:49.112737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:49.120162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.120611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.121375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.121864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.151747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b76ba1d-936e-4431-8643-b757c9793b42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046012 Aug 02 10:27:49.152295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 559/1108] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:49.542068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:49.544325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:49.550487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.550932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.551724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.552159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.554524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:49.581649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-06cf45e5-a26d-4d77-9ef1-bbbd7b19b3f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Aug 02 10:27:49.582307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 550/1109] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:49.629919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:49.632105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:49.639009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.639479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.640234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:49.640663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:49.670086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fb4587aa-29fd-48ae-bfd7-a6a6ce64a83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Aug 02 10:27:49.670635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 560/1110] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:50.165324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:50.167522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:50.174583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.175058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.175843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.176309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.205590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3030f752-4aa8-4624-8ff1-7eb050768d43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044597 Aug 02 10:27:50.206140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 551/1111] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:50.594273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:50.596474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:50.602421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.602895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.603665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.604103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.632817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a65bcd8-44da-4e6f-bc51-68eac1cd1970 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042659 Aug 02 10:27:50.633465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 561/1112] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:50.682643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:50.685459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:50.691468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.691915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.692672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:50.693106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:50.723429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5922ff26-cb69-4699-866e-b4ae140ab60a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 02 10:27:50.723976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 552/1113] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:51.218334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:51.220439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:51.226885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.227369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.228136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.228572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.257557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-94dec724-11ad-47d9-bbfb-3557ebf9817c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043932 Aug 02 10:27:51.258109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 562/1114] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:51.645905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:51.648140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:51.654621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.655663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.656433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.656862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.685086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad579584-b596-442c-81cc-e2a8edd98c05 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Aug 02 10:27:51.685898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 553/1115] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:51.735578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:51.737707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:51.743709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.744157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.744920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:51.745352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:51.774300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6a62f77-43a1-4c50-9e29-594b16b8bac9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Aug 02 10:27:51.776291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 563/1116] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:52.270658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:52.272832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:52.278900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.279390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.280152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.280585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.310460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b3a51576-c4eb-4ce8-87e9-68bbc0ccbcdc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043486 Aug 02 10:27:52.312215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 554/1117] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:52.697348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:52.700585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:52.707407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.707861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.708630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.709210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.740028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82bdb739-0b7a-4a91-9425-74ecc0b20d08 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Aug 02 10:27:52.740681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 564/1118] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:52.786754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:52.788878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:52.796115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.796569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.797361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:52.797794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:52.826688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-85f9908b-dd1f-48c1-b38a-b247c2d6c726 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Aug 02 10:27:52.827269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 555/1119] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:53.324531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:53.327266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:53.333360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.333803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.334556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.335031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.363590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a4154240-96c8-451b-a6f8-27c56ff1cade tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043103 Aug 02 10:27:53.364131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 565/1120] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:53.753365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:53.755565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:53.761892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.762355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.763111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.763564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.793591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d95c11db-f501-4ac0-8072-86340eef7c6c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Aug 02 10:27:53.794243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 556/1121] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:53.838574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:53.840765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:53.847143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.847633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.848400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:53.848837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:53.879215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7150b90a-76fb-4201-b679-a8539a03a850 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 02 10:27:53.879783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 566/1122] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:54.376614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:54.378799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:54.380755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=86 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:54.385706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.386151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.386967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.387433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.417798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7e831b9a-9963-4af6-ac5a-6cac87d6c57a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045521 Aug 02 10:27:54.418350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 557/1123] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:54.806863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:54.809046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:54.815340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.815780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.816530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.816958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.847100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e01b5594-e7ec-4cef-8864-b198ca790e4f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Aug 02 10:27:54.847852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 567/1124] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:54.892536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:54.894771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:54.901502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.901947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.902705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:54.903137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:54.935937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1555e42c-3c9e-466e-b486-ce0ca9cbd83a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048330 Aug 02 10:27:54.937016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 558/1125] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:55.430924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:55.433225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:55.440032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.440473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.441224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.441653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.470135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5eefe9bc-e96b-41de-9c41-805233dc6763 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043288 Aug 02 10:27:55.470680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 568/1126] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:55.860515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:55.862711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:55.868783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.869227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.869984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.870418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.899759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-41cc45ee-fece-4c1d-a593-cb591bc4fb41 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Aug 02 10:27:55.900481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 559/1127] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:55.949086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:55.951232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:55.958007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.958450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.959229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:55.959668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:55.988799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7d420914-d59a-42f9-80ff-d0dfa279f970 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Aug 02 10:27:55.989350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 569/1128] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:56.482755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:56.485655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:56.492014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:56.492456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:56.493213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:56.493644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:56.523919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c8bde4c1-927a-4d13-8525-806c740917af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045336 Aug 02 10:27:56.524587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 560/1129] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:56.912767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:56.915088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:56.921777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:56.922219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:56.922981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:56.923444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:56.952837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-02976be6-d049-4d1c-8704-3570be4ec367 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Aug 02 10:27:56.953512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 570/1130] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:57.001195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:57.003401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:57.010021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.010459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:57.011237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.011670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:57.040838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-33db6e5c-23a1-4fee-841f-f159e2cf4152 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Aug 02 10:27:57.041422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 561/1131] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:57.536105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:57.538243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:57.545321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.548107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:57.548107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.548107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:57.577683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b55eb7dc-1918-4bfa-b0e8-3a47a92048ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045608 Aug 02 10:27:57.578236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 571/1132] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:27:57.965513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:57.968128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:57.974338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.974775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:57.975563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:57.975993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:58.004689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0261b1bb-426a-4082-a611-a782e983fb81 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Aug 02 10:27:58.005504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 562/1133] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:58.052906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:58.055081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:58.061106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:58.061613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:58.062371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:58.062806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:58.066460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:27:58.091090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1938e6e7-7aa2-438d-a849-8cd7dd87fe83 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Aug 02 10:27:58.091704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 572/1134] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:58.590336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:58.592531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:58.599108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:58.599587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:58.600352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:58.600791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:58.631251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04846ec1-c989-47e9-8dc0-f49493370e71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045067 Aug 02 10:27:58.631816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 563/1135] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:27:59.017989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:59.020173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:59.026598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.027037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.027831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.028260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.056936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-26ecadd6-98c5-4b23-9b57-3b33466bab69 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Aug 02 10:27:59.057594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 573/1136] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:27:59.103346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:59.105517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:59.111555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.112002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.112765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.113199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.142918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7462376e-0dcf-4959-9e6c-4012a318d9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Aug 02 10:27:59.143515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 564/1137] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:27:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:27:59.644328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:27:59.646514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:27:59.652674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.653122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.653883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:27:59.654321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:27:59.684493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56d4a246-a1a7-44cd-b8ff-fa3df5d88f84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044324 Aug 02 10:27:59.685044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 574/1138] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:27:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:00.068771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:00.070962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:00.077664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.078114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.078888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.079361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.108680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e04cccbe-cb97-41a8-8222-8f2476bb866e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Aug 02 10:28:00.109325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 565/1139] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:00.156138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:00.158336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:00.164788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.165240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.166011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.166450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.196026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0100bdca-5d7a-4c1b-b603-946aa153cd3e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Aug 02 10:28:00.196611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 575/1140] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:00.697286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:00.699388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:00.705619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.706096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.706859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:00.707325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:00.731897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:00.736877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c3f9d66-2590-4669-9da4-00f7866e2670 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043804 Aug 02 10:28:00.737430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 566/1141] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:01.121097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:01.123520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:01.129550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.130014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.130783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.131230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.159592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dd78fa71-e06c-4ebb-af23-575e3ca2fd6e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Aug 02 10:28:01.160235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 576/1142] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:01.208996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:01.211225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:01.218472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.218935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.219763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.220234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.249478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6b92c50-3534-42b3-8df7-00a40e7f06fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 Aug 02 10:28:01.250028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 567/1143] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:01.749951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:01.752136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:01.758679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.759131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.760003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:01.760443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:01.789372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-66a2475e-85c4-4459-95dd-1123cc7de896 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043790 Aug 02 10:28:01.789933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 577/1144] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:02.100565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:28:02.100787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:28:02.172074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:02.174219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:02.180432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.180877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.181660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.182120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.215983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c054c6f-5a7c-4987-8949-05ccbadf2b4a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048422 Aug 02 10:28:02.216616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 568/1145] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:02.262020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:02.264197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:02.271690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.272140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.272905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.273338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.301383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9342d345-dafc-4279-acd0-033cabb67ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Aug 02 10:28:02.301932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 578/1146] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:02.801962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:02.804177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:02.810210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.810653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.812000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:02.812438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:02.817745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:28:02.817983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments (ip 10.222.0.49) !!! Aug 02 10:28:02.845810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-54003f9c-d6c6-40bf-9e85-35ed1cd83d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047734 Aug 02 10:28:02.846358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 569/1147] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:03.227834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:03.229971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:03.237076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.237521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.238281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.238720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.267725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a4679438-9247-415a-a725-b1c3be8788e8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Aug 02 10:28:03.268344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 579/1148] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:03.313861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:03.315994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:03.322413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.322858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.323658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.324115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.353820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-214850e5-a38f-4f5a-8869-4367be0b91a4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 02 10:28:03.354379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 570/1149] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:03.858341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:03.860533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:03.866657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.867105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.867950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:03.868390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:03.898625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7e0d343e-70f2-48e1-87ab-f93e71776037 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044241 Aug 02 10:28:03.899169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 580/1150] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:04.280252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:04.282471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:04.288675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.289117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.289978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.290361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.319558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3761a660-d63e-451c-a518-940f49cffdb3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 02 10:28:04.320210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 571/1151] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:04.366137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:04.368342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:04.370710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=88 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:04.376197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.376643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.377412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.377851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.406820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-265e3507-49b1-4052-ad8b-5bd0ac5f69db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 02 10:28:04.407391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 581/1152] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:04.911122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:04.913258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:04.920272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.920391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.921060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.921493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.951361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc0aca44-01b5-4e4e-af39-616dab86ebbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Aug 02 10:28:04.951913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 572/1153] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:05.332675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:05.334924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.341127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.341673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.342516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.342949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.374086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-58e2966f-9283-4446-8db2-b71ddb0317fd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Aug 02 10:28:05.374864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 582/1154] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:05.418914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:05.421117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.427133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.427610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.428375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.428811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.458316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-141b3782-9eb6-4c1b-8d0f-17f547fb225f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Aug 02 10:28:05.458873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 573/1155] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:05.964194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:05.966303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.973248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.973696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.974456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.974893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.004947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3f61b5e5-659b-42b0-9e14-308f7d89d471 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044823 Aug 02 10:28:06.005495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 583/1156] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:06.386528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:06.388732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:06.395742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.396193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.396959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.397401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.426487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-075be16a-af6f-4ef8-bc61-e6f41503ef7c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 02 10:28:06.427152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 574/1157] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:06.471686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:06.473828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:06.480676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.481155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.481912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.482345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.516731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8c76018-7fb8-470a-8807-f507470bc073 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049392 Aug 02 10:28:06.517307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 584/1158] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:07.017731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:07.019959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:07.026156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.026602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.027456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.027895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.057821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8493a86d-9894-4ade-ab69-80030f0f4e20 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044796 Aug 02 10:28:07.058372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 575/1159] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:07.439655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:07.441715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:07.447749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.448198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.449052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.449569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.480633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a3c4b91-f39c-4d4f-985d-7c9ca96f70d4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Aug 02 10:28:07.481261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 585/1160] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:07.529497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:07.540623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:07.540623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.540623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.540623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.541524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.570094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f465fed7-9d4e-4a2c-98a1-1afb22088e39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 02 10:28:07.574964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 576/1161] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:08.070572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:08.072989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:08.079742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.080198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.080954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.081389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.111264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b4bc722d-621f-4f4a-9653-9f89f26de69b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044911 Aug 02 10:28:08.112047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 586/1162] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:08.492822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:08.495316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:08.506529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.507012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.507943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.508392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.541727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03c3db84-9399-435b-8f75-53e15f90dfd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053075 Aug 02 10:28:08.542381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 577/1163] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:08.583267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:08.585427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:08.592753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.593234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.594005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.594443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.623790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e668bd03-b34f-4983-8c14-e5e911ac0c8a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Aug 02 10:28:08.624339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 587/1164] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:09.124298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.126534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:09.132683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.133131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.133899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.134337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.165061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-900a590b-85c0-4133-86e9-82de36c66893 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045055 Aug 02 10:28:09.165667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 578/1165] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:09.554107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.556293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:09.562379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.562830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.563635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.564078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.588998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:09.593793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b763dabd-1b00-47a3-ab33-78999f9b7dc9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Aug 02 10:28:09.594971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 588/1166] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:09.636680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.638820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:09.645838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.646288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.647042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.647505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.676067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc7c36c8-836f-4e02-bf07-a2a97bf7d187 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Aug 02 10:28:09.676613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 579/1167] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:10.177703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:10.179802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:10.186162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.186612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.187415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.188355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.218409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f8fd1471-8dc2-4a4f-b246-7f9d8f0d99a5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044778 Aug 02 10:28:10.218991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 589/1168] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:10.606768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:10.608944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:10.615736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.616196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.616965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.617402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.649108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a688cd0-d0c2-4140-b667-5c9c1b122f70 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Aug 02 10:28:10.649855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 580/1169] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:10.688262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:10.690424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:10.696975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.697426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.698181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.698615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.727811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a238c82-5415-4e03-b278-7ed71ece40d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Aug 02 10:28:10.728373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 590/1170] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:11.230447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:11.232557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:11.239147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.244656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.244656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.244656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.272420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-32b60842-c6cc-4a13-8330-28253c603772 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Aug 02 10:28:11.273277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 581/1171] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:11.661894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:11.664104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:11.670182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.670754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.671550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.671991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.701310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ba21c99-5e46-4627-9f19-4f6c7e4bf067 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Aug 02 10:28:11.701985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 591/1172] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:11.740464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:11.742610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:11.749555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.750004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.751315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.751764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.781743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4730d113-ee8d-45f9-82a1-02d8bc5502de tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Aug 02 10:28:11.782313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 582/1173] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:12.001157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:28:12.001506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:28:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:28:12.285344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.287580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.293911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.294345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.295112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.295702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.325306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8ee95ebc-bd00-4470-b121-b60c5089419c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044635 Aug 02 10:28:12.325897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 592/1174] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:12.714580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.716735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.723475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.723919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.724752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.725184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.738704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:12.754971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5116998a-9d6f-4516-b7c9-eb664e6399dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 02 10:28:12.755641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 583/1175] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:12 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:12.794343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.796488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.803099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.803658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.804551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.804990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.833392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cc31a542-7ab2-4f45-9260-1d36c256baf8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Aug 02 10:28:12.833934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 593/1176] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:13.337556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:13.339729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:13.345969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.346418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.347175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.347656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.377408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b7252a63-99b3-4b6c-965f-44f5d5c85860 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044213 Aug 02 10:28:13.378045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 584/1177] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:13.766797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:13.769005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:13.775022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.775510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.776277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.776716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.807165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc644139-dde5-4b42-859b-173ee88cbc22 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Aug 02 10:28:13.807948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 594/1178] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:13.846101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:13.848340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:13.855075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.855550 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.856342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.856781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.885836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-93ec1f59-e49d-419f-88e4-3f2d1378337d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Aug 02 10:28:13.886389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 585/1179] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:14.390343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:14.392955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:14.399258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.399710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.400489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.400924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.430588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-09a775df-052e-4307-9767-b3e8d1d50e08 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Aug 02 10:28:14.431135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 595/1180] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:14.820255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:14.822507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:14.829436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.829883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.830645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.831114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.860762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e6bf7ab3-e723-42e5-ae7f-87d7d4997d75 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Aug 02 10:28:14.861396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 586/1181] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:14.898702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:14.900820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:14.907046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.907528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.908296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.908729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.937758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5b5f40e3-95f1-4703-8a1c-1f06b4ff7c37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Aug 02 10:28:14.938799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 596/1182] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:15.443494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:15.445723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:15.452120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.452562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.453319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.453781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.482440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0dc21fa9-0fad-43f1-90cf-07cf880ef313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043036 Aug 02 10:28:15.482991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 587/1183] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:15.873336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:15.876321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:15.882906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.883388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.884146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.884651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.913883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-33154318-3d7e-4378-b4af-6e815e02df2a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Aug 02 10:28:15.914542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 597/1184] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:15.950055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:15.952230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:15.958795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.959268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.960059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.960497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.989060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-31588e0f-c11b-41d1-a70f-7df86a5a2f7b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Aug 02 10:28:15.989611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 588/1185] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:16.495559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:16.497655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:16.504361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.504803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.505565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.505999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.542239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6a0a70a-b529-423a-8852-c7dc508e0aba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050753 Aug 02 10:28:16.542837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 598/1186] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:16.926247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:16.928464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:16.934570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.935014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.935805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.936245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.965695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89232a51-e846-46b7-849e-ff94fa7e1f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043438 Aug 02 10:28:16.966386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 589/1187] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:17.001873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:17.004081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:17.010503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.010952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.011754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.012190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.041482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b23bdfc3-62fd-454e-88a4-6a3ac1e7af61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Aug 02 10:28:17.042029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 599/1188] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:17.554959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:17.557125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:17.563417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.563871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.564695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.565136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.595312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c7017c0c-7a34-498d-a9ac-725ed58efd42 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043838 Aug 02 10:28:17.595932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 590/1189] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:17.978819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:17.980983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:17.987007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.987500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.988258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.988691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:18.018395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-069ecfbc-b06f-4710-a003-bee9d0d3ff2d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Aug 02 10:28:18.019075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 600/1190] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:18.053878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:18.056263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:18.063548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:18.064001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:18.064806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:18.065241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:18.093710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-150f8dd7-8173-4ee5-8cae-39abf3024b50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Aug 02 10:28:18.094277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 591/1191] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:18.608153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:18.610965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:18.617142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:18.617588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:18.618350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:18.618780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:18.648809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3acea00-8e45-44e1-b5ca-73aa90bf91e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044750 Aug 02 10:28:18.649345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 601/1192] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:19.030082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:19.032879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:19.039046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.039527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.040281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.040724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.069863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f384b8f0-1d56-4bf7-be51-d10fc8db9920 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Aug 02 10:28:19.070533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 592/1193] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:19.105822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:19.107986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:19.114398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.114847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.115641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.116080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.144389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f0f4bcfa-d254-429a-b671-17c51590893f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Aug 02 10:28:19.144933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 602/1194] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:19.661714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:19.663829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:19.669830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.670284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.671046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.671517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.700929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6764cf57-c823-418a-a975-bdff6e9d0651 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043401 Aug 02 10:28:19.701483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 593/1195] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:20.082362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:20.084584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.090577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.091020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.091818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.092255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.122971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b4e5973-97f4-407a-a7a1-3d3afb85ce80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 02 10:28:20.123707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 603/1196] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:20.156767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:20.159425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.166150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.166596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.167380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.167818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.196312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a1afef82-9e10-49a4-8f79-e049e5951d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Aug 02 10:28:20.196876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 594/1197] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:20.480557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:20.481234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.487163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.487641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.488400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.488920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.511679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lazy-loading 'flavor' on Instance uuid 66280587-b1b9-4573-af14-c7ddfeaa86a6 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:28:20.644438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:20.713275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:20.715483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.721626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.722069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.722821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.723275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.753948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e7ccb142-e486-45fc-99c7-37e098f63fa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Aug 02 10:28:20.754513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 595/1198] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:20.863359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2396b2c8-d4c5-4c7c-8eae-ea07281f6122 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "POST /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6/action" status: 202 len: 0 microversion: 2.1 time: 0.386452 Aug 02 10:28:20.863944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 604/1199] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:28:20 2022] POST /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:28:20.872358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:20.874373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.880825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.881273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:20.882069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:20.882501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.017412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:21.025024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8e560bfc-2067-4d13-abc5-57f957ecb600 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156686 Aug 02 10:28:21.025582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 596/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:21.136901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:21.139078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:21.145848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.146284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.147036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.147522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.176379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb71cee6-1517-48a8-8d46-84860e4e270e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Aug 02 10:28:21.176912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 605/1201] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:21.209147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:21.211454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:21.218171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.218606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.219398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.219833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.249686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c423489c-2ccd-4cff-af7a-a71b93009346 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Aug 02 10:28:21.256729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 597/1202] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:21.766463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:21.769289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:21.775382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.775828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.776593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.777025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.805400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b57189f-7f40-40e4-897a-3d5d2a8adfd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042912 Aug 02 10:28:21.805951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 606/1203] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:22.047271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.048044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.054033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.056908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.056908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.056908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.184031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:22.188092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.190275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.191565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-81247705-91da-4130-becd-2831b2ac39a2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.148213 Aug 02 10:28:22.192146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 598/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:22.197278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.197732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.198571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.199087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.231751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d890de8-11de-48a9-83fc-f99aa93cb15b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Aug 02 10:28:22.232325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 607/1205] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:22.265994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.268800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.275290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.275731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.276490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.276919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.305292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4ef754c-b939-454f-ab90-f52735cb3a9f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 Aug 02 10:28:22.305758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 599/1206] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:22.818857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.820955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.827049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.827525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.828295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.828730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.856710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d733a2df-16de-4caa-ae7c-96affb575cfb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042619 Aug 02 10:28:22.857265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 608/1207] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:23.212958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:23.213480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:23.219647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.220082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.220980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.221415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.225559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:23.244807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:23.247169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:23.254622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.255073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.255907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.256347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.286793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ea7e7685-c15e-45bd-b344-f52c85cbfe3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Aug 02 10:28:23.287386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 609/1208] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:23.318236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:23.320449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:23.326448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.326897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.327708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.328145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.353976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:23.357023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-22bc8947-b3fe-4280-98a5-0f43ce93420a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 02 10:28:23.357598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 610/1209] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:23.361558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-654d56a0-8c32-4032-94ae-6e6159d546a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152708 Aug 02 10:28:23.362119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 600/1210] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:23.869570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:23.871724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:23.878067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.878513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.879323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.879765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.909673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fd4a0fb7-a6b7-4d74-a486-1aebf6458f5e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Aug 02 10:28:23.910223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 611/1211] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:24.299525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.301722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.307827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.308269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.309015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.309442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.338414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c0ef885-deb5-44ac-a63c-f60042880d51 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Aug 02 10:28:24.338961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 601/1212] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:24.369130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.371350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.378032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.378479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.379260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.379702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.382906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.383575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.389898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.390343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.391104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.391575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.410935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-739d32ef-4eb4-4609-92ad-95a39ab8e9da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Aug 02 10:28:24.411524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 612/1213] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:24.528068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:24.535845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8093eefb-1327-4e96-a7ca-710689cd67f9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156657 Aug 02 10:28:24.536412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 602/1214] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:24.922145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.924881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.930978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.931464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.932233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.932675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.962184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5b2913b4-efa4-4969-b055-b87c1666c632 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044029 Aug 02 10:28:24.962736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 613/1215] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:25.350802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.352996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.355465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=92 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:25.360283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.360726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.361485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.362575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.393486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da702226-fc35-4dd5-981b-c24a1df0ab64 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 Aug 02 10:28:25.394178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 603/1216] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:25.423369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.426115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.432164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.432609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.433420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.433850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.461613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b9a840b0-53b3-442d-a30f-b1b944a38087 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Aug 02 10:28:25.462153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 614/1217] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:25.559325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.559921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.566320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.566717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.567528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.567956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.696688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:25.705088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-29dfecaf-6b4e-4089-a244-57b5c7dae30d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.149678 Aug 02 10:28:25.706156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 604/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:25.975160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.977279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.983303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.983750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.984505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.984938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.015333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ce26aec9-6799-4830-bed2-a90e11f8ac83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044561 Aug 02 10:28:26.015895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 615/1219] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:26.406877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:26.409724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:26.416499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.416933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.417686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.418110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.447433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34b5ecdc-9dea-4852-b066-c75ec3c7dcad tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 02 10:28:26.447976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 605/1220] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:26.474605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:26.476771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:26.483346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.483793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.484553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.484993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.513204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5c04084-d234-4ebf-857a-5e6f40f5d8da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Aug 02 10:28:26.513766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 616/1221] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:26.728244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:26.728776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:26.735112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.735461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.736225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.736672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.874645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:26.882646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-38d6e359-7c17-46df-8eb2-3659bad78bed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158360 Aug 02 10:28:26.883214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 606/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:27.028252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.030420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.036524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.036969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.037763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.038198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.068341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-402cdd55-fb61-4b62-ac31-c234609c0a7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044045 Aug 02 10:28:27.068883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 617/1223] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:27.459984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.462099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.468699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.469143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.469897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.470330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.499376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cce05455-8492-4551-806e-7ace0ad5ac71 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Aug 02 10:28:27.500184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 607/1224] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:27.525565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.527731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.534875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.535350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.541241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.541241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.566214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3ad2550b-fc5a-4d2e-9ccd-f2d8d4b6e561 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Aug 02 10:28:27.566761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 618/1225] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:27.903645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.904247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.910921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.911496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.912249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.912709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.041933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:28.049526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5a233c71-e24e-49ba-852b-3ba5449ae0f5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.149733 Aug 02 10:28:28.050085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 608/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:28.079855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:28.082493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:28.088502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.088953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.089724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.090160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.118906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ba617aa1-0278-425f-bb67-c68645067b48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043032 Aug 02 10:28:28.119484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 619/1227] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:28.512806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:28.514981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:28.522273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.522715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.523505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.523941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.552975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-734f490b-a891-493d-b2ba-67d480c58be7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 02 10:28:28.553512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 609/1228] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:28.577977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:28.580140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:28.587267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.587707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.588455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.588884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.592575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:28.617437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2e0a9ba2-e326-471e-be8f-05e05209ea74 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043449 Aug 02 10:28:28.617969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 620/1229] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:29.070372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:29.070976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:29.077009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.077448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.078208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.078636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.132345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:29.134412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:29.141336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.141783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.142546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.142973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.173439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-60e1ab1d-cf1e-4f90-9003-1056ef2108f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045645 Aug 02 10:28:29.174296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 621/1230] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:29.213829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:29.221446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03b8cd2e-1506-40fe-9273-01d3a7aa3cd3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155435 Aug 02 10:28:29.227175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 610/1231] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:29.565830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:29.568725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:29.575139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.575622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.576399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.576835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.605344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e60fa924-652e-472c-8d91-00dcbf32f040 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Aug 02 10:28:29.606030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 622/1232] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:29.630630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:29.632941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:29.639447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.639863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.640617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.641048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.668796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0af0a278-add4-4a7d-9fde-65a45b682e9c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Aug 02 10:28:29.669339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 611/1233] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:30.186113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.188265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.194745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.195786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.195991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.196432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.226809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ff255249-82aa-49b9-a347-a11e5d9b83bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044736 Aug 02 10:28:30.227392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 623/1234] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:30.243006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.243637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.249916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.250358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.251104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.251564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.382346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:30.390067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ff7fc1b3-4cf5-4adc-8cdc-af0349617de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150779 Aug 02 10:28:30.390632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 612/1235] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:30.617905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.620089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.626855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.627373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.628169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.628606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.657933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6df32034-582b-475e-ba8c-ee6d60899592 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Aug 02 10:28:30.658477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 624/1236] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:30.789942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.792239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.798305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.798754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.799551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.799995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.828423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-05fd7cd8-ec34-4de8-b5b6-50c09b6fd908 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151366 Aug 02 10:28:30.828984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 613/1237] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:31.238961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:31.241802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:31.247907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.248352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.249147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.249833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.279181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ab4ffc87-2f51-4ced-8dce-8704ee473b95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044166 Aug 02 10:28:31.279801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 625/1238] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:31.412490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:31.413098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:31.419257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.419700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.420457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.420887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.653283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:31.660858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2dace93d-43d4-415b-b83e-3bf6c9e2df69 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.252830 Aug 02 10:28:31.662007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 614/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:31.680719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:31.682912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:31.689489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.689938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.690717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.691158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.720256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3995579c-25c8-4b93-b7ff-d927366fe509 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Aug 02 10:28:31.725240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 626/1240] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:31.841348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:31.843521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:31.851367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.851808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.852569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.852994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.882599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-314811cb-a11f-4258-90da-39199e39edd4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Aug 02 10:28:31.883075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 615/1241] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:32.291655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.293777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.300302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.300797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.301612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.302209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.331779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46b2b794-e861-4e2e-a836-6e522204f5e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Aug 02 10:28:32.332329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 627/1242] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:32.683688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.684212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.690281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.690733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.691515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.691953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.733002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.735236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.742355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.742803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.743599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.744035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.773736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-005ddab2-d769-44ac-977e-3dfb5e2e1be4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Aug 02 10:28:32.774303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 628/1243] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:32.822015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:32.824232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:32.830349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-39f7f119-db0b-436c-94b9-71ba779c2724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150545 Aug 02 10:28:32.830918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 616/1244] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:32.893980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.896245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.902241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.902687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.903488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.903927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.933130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cbfd089-5f26-43a6-9691-c06f09099a6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 Aug 02 10:28:32.933683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 629/1245] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:33.349784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.351864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.358379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.358827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.359626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.360062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.388912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d60ba5bf-70ae-493d-b70c-78b68e1e80fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044203 Aug 02 10:28:33.389481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 617/1246] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:33.785631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.787836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.794237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.794700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.795531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.795971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.825762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2808b855-fb5e-432b-908c-e188e14d0940 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 02 10:28:33.826318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 630/1247] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:33.869101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.870289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.876842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.878639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.878639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.878639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.946729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.949226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.952210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:33.956763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.956763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.957868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.958307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.989115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c21bd16f-8ba3-44cd-bcd5-7be749703165 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047064 Aug 02 10:28:33.989686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 631/1248] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:34.012140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:34.021159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-298ce1e7-bde6-4941-8d59-803ab692a0c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156602 Aug 02 10:28:34.022146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 618/1249] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:34.401107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:34.403322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:34.409400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.409847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.410614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.411053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.440516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ede86745-e828-4a4b-9436-bbec7178c3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043403 Aug 02 10:28:34.441061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 632/1250] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:34.838727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:34.840979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:34.847528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.847976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.848740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.849178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.879723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af2a8745-9786-4d09-b6ef-88e392b165b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 02 10:28:34.880036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 619/1251] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:35.002014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:35.004448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:35.011765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.012219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.012965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.013396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.042423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:35.042727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1a240c31-fd8f-4689-8f93-f921b7db1818 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Aug 02 10:28:35.043033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:35.043313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 633/1252] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:35.049343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.049788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.050544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.051018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.184952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:35.192409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1d16928e-f0cc-407a-9901-485344047128 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153890 Aug 02 10:28:35.192978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 620/1253] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:35.455324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:35.458035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:35.464408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.464852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.465610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.466042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.495895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78d54619-2f8f-4fa4-af10-04aa0926cd6d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046652 Aug 02 10:28:35.496483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 634/1254] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:35.892270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:35.894462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:35.901152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.901595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.902355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:35.902787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:35.932705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c998502-7e9e-4827-9c86-5adfe726b9aa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 02 10:28:35.933264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 621/1255] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:36.054149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:36.056430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:36.062966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.063539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.064295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.064732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.093341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7800ef67-5e5c-4132-9a48-b692aa0eb52e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Aug 02 10:28:36.093879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 635/1256] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:36.215169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:36.215800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:36.222156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.222598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.223430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.223867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.359307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:36.366893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c54eb081-027a-4cd7-b045-dd95cef78de9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155689 Aug 02 10:28:36.367467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 622/1257] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:36 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:36.477066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-46e632d1-ed22-42d1-aedb-81e4e3d645bc req-c3b2d8cb-d317-44b4-93ae-a237ee872ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "name": "network-vif-unplugged", "status": "completed", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:36.487535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-46e632d1-ed22-42d1-aedb-81e4e3d645bc req-c3b2d8cb-d317-44b4-93ae-a237ee872ff8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.487980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-46e632d1-ed22-42d1-aedb-81e4e3d645bc req-c3b2d8cb-d317-44b4-93ae-a237ee872ff8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.498718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-46e632d1-ed22-42d1-aedb-81e4e3d645bc req-c3b2d8cb-d317-44b4-93ae-a237ee872ff8 service nova] Creating event network-vif-unplugged:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:28:36.505998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-46e632d1-ed22-42d1-aedb-81e4e3d645bc req-c3b2d8cb-d317-44b4-93ae-a237ee872ff8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086965 Aug 02 10:28:36.507401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 636/1258] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:36.509709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:36.512201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:36.518414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.518937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.519825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.520320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.560392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-51d13a16-f204-41e2-aad4-f4823dca00ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055617 Aug 02 10:28:36.560967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 623/1259] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:36.945022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:36.947918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:36.954072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.954514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.955300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.955739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.971904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:36.984104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5275260e-eaef-4780-ad37-b78c308fc994 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Aug 02 10:28:36.984652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 637/1260] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:37.105793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:37.108014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:37.114497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.114988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.115762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.116203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.145701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e6c07fc8-b1a7-4156-9005-b79c985ae2e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Aug 02 10:28:37.146258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 624/1261] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:37.390078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:37.390699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:37.397795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.398299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.399123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.399581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.531023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:37.539672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a6d35538-d5de-408f-8ce8-7246ea28c78a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152884 Aug 02 10:28:37.540235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 638/1262] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:37.572812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:37.574994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:37.581004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.581443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.582192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.582746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.612581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e683861b-8b49-4dc5-9dcf-d4d09afebf6a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043682 Aug 02 10:28:37.613137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 625/1263] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:37.996679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:37.999093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:38.005516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.005962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.006726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.007160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.036553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e9205ce2-1da2-4271-93b0-fa66b72b7575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 02 10:28:38.037100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 639/1264] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:38.158206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:38.160294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:38.167033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.167503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.168255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.168711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.198018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-897012f2-d230-4cb1-ae69-0d9eaff6f363 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Aug 02 10:28:38.198600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 626/1265] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:38.562045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:38.562660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:38.569179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.569624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.571033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.571541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.625213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:38.627387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:38.633728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.634169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.634927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:38.635409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:38.665583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4ddcc99-88ba-4b84-a2ee-209ac34f07af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044616 Aug 02 10:28:38.666154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 627/1266] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:38.713353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:38.721921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a26e431-60ff-4b43-9e31-7a8b1f298fae tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164003 Aug 02 10:28:38.722488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 640/1267] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:39.049245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:39.051445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:39.060548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.061207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.061975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.062407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.095692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-080e2c10-9ef7-452e-8cd2-15d01f7741dc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050409 Aug 02 10:28:39.096250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 628/1268] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:39.210391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:39.212715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:39.218651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.219099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.219892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.220326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.248348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2af4e204-285c-4612-8b84-c5b472c51e10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Aug 02 10:28:39.248896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 641/1269] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:39.678231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:39.681190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:39.687763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.688203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.688950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.689375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.718259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-21b35ca0-4e18-498b-97c9-0e4925f0f002 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Aug 02 10:28:39.718867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 629/1270] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:39.747796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:39.748406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:39.755088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.755567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.756326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:39.756760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:39.889169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:39.897057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7b20581d-5d74-4f86-8744-24a721f0ce98 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153298 Aug 02 10:28:39.902558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 642/1271] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:39 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:40.109060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:40.111214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:40.117307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.117753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.118524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.118984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.148038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-116cb81b-3e44-427b-8fc9-5be91656e9cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Aug 02 10:28:40.149180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 630/1272] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:40.261215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:40.263443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:40.269645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.270091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.270882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.271344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.299977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9c390398-4637-43e2-b2c5-bb8735d8b842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Aug 02 10:28:40.300515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 643/1273] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:40.731433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:40.733683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:40.740659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.741109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.741894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.742453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.770824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-53092750-cc9f-48c7-a8ce-81e35c875c77 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044047 Aug 02 10:28:40.771409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 631/1274] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:40.918558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:40.919096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:40.925606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.927294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:40.927294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:40.927562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.062261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:41.069806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-16aff143-2829-470e-8f25-f1efe295d724 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155348 Aug 02 10:28:41.070878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 644/1275] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:41.161119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:41.163269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:41.169836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.170223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.171032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.171491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.201451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-975a7ec1-1d2c-4487-af12-c74d0aafabb7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Aug 02 10:28:41.202019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 632/1276] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:41.312481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:41.314638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:41.320672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.321113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.321870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.322302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.350684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-273f2bfb-8582-48c0-97a2-70f229babfd3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042237 Aug 02 10:28:41.351260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 645/1277] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:41.783995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:41.786069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:41.793284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.793790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.794593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:41.795024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:41.809452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:41.825120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1b814fb-f3f1-4cc6-97ab-9f7ae821cab3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045315 Aug 02 10:28:41.825667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 633/1278] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:42.092314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:42.092873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:42.099625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.100073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.100832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.101315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.214234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:42.216610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:42.223080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.223632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.224412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.224850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.231876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:42.239424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-47bb3987-002d-4d1c-972c-78a9bb5a8a7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151040 Aug 02 10:28:42.239983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 646/1279] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:42 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:42.254929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd169ae5-8f4c-42f6-8a49-27121f976099 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Aug 02 10:28:42.255514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 634/1280] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:42.363621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:42.365729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:42.371679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.372151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.372921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.373357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.402028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2fb4c4e1-f4ec-4aad-86cd-04524781684b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Aug 02 10:28:42.402574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 647/1281] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:42.837791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:42.840009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:42.846482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.846929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.847726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:42.848165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:42.876985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6e369d30-11d1-49f6-af62-1abe89eda6be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Aug 02 10:28:42.877539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 635/1282] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:43.261447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:43.262097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:43.267299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:43.268787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.269236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.269462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:43.270008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.270449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.275595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.276033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.276790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.277218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.308221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6439a2f7-7fe3-4aab-9873-24dc484e3b8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Aug 02 10:28:43.308792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 636/1283] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:43.399055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:43.406767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d096a910-33ef-4416-adb2-ac39abb92e48 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.149336 Aug 02 10:28:43.408415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 648/1284] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:43.414184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:43.417403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:43.423490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.423942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.424714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.425148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.454750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0a84ecc9-8ace-4854-9553-302562e58054 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 02 10:28:43.455538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 637/1285] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:43.890614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:43.892723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:43.899814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.918035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.918035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:43.918035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:43.934182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7a05f1a5-7392-4e9f-ba1f-88742bba79b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047760 Aug 02 10:28:43.934768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 649/1286] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:44.321561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:44.323788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:44.330766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.331219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.332011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.332448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.366130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0420ef8b-3777-4a1e-96f2-c477a10905b2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049342 Aug 02 10:28:44.366731 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 638/1287] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:44.429637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:44.430759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:44.437625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.438069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.438845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.439398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.467737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:44.469963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:44.476575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.477046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.477834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.478261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.513172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b501c1b-34ea-4272-865a-5dd77918249d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049590 Aug 02 10:28:44.513965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 639/1288] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:44.589241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:44.597442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e07e49b-a750-4578-a01a-f6b960e094ad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.171704 Aug 02 10:28:44.598029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 650/1289] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:44.946920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:44.949011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:44.955149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.955624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.956387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:44.956814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:44.987037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7bff3ca0-1204-4e31-b9fa-35d6f0fcca18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Aug 02 10:28:44.987647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 640/1290] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:45.380002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:45.382281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:45.388930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.389372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.390134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.390593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.420588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-35038471-259e-4ee6-a42a-1d7d63899ba6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 02 10:28:45.421140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 651/1291] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:45.525954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:45.528199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:45.534888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.535410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.536212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.536639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.566103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b40bc994-32c6-41c2-b584-ade18ff94b0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Aug 02 10:28:45.566668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 641/1292] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:45.620220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:45.620816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:45.627691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.628132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.628937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:45.629368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:45.758286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:45.765984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0e896201-ed59-4120-8cce-044777350c9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150351 Aug 02 10:28:45.766542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 652/1293] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:45.999908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:46.002285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:46.008518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.008961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.009714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.010141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.039107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e0782f7-cc8f-4276-8c4c-aec929a0a56e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043532 Aug 02 10:28:46.040319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 642/1294] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:46.432893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:46.435078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:46.441662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.442433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.443413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.443896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.484908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e9a9687-05f4-46e7-bd64-537b69466a7d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056574 Aug 02 10:28:46.485555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 653/1295] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:46.578107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:46.580316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:46.587263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.587706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.588513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.588942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.617498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0a773d70-3980-44aa-840d-72a21403eb23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Aug 02 10:28:46.618100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 643/1296] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:46.787955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:46.788575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:46.796342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.796796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.797595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:46.797999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:46.802230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:46.932476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:46.940375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3083abfc-8f50-408e-99dd-0091024608d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156407 Aug 02 10:28:46.940965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 654/1297] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:46 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:47.052447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:47.054572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:47.060785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.061222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.062016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.062449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.092471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af34b214-c556-4b25-9b46-5778a1720b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044284 Aug 02 10:28:47.093023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 644/1298] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:47.497816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:47.500049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:47.506899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.507395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.508192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.508632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.541384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-65cff4f8-f9ce-4e75-841c-e7e882503913 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Aug 02 10:28:47.541939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 655/1299] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:47.630312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:47.632496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:47.639595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.640035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.640790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.641223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.670040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89707fcb-e76f-4592-85b4-80b9b29b0586 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 02 10:28:47.670593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 645/1300] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:47.962183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:47.962740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:47.969218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.969656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:47.970409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:47.970861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.105909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:48.106151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:48.108096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:48.113877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0eeab0d0-cc67-4ae4-b572-3b7c8ffbb810 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155776 Aug 02 10:28:48.114119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.114447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 656/1301] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:48.114597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.115376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.115818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.148087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-168379d9-6e34-4ced-9950-ebd12ab25045 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046898 Aug 02 10:28:48.148692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 646/1302] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:48.553714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:48.555937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:48.561982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.562471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.563260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.563694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.595415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6056c72f-b818-44c0-8dc4-09e6e7fe8433 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Aug 02 10:28:48.595984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 657/1303] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:48.681751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:48.683968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:48.690557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.691040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.691827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:48.692257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:48.722405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e62c4de4-e4a4-4b82-a19f-87e36e544bbf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Aug 02 10:28:48.722957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 647/1304] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:49.137524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:49.138239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:49.145462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.145907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.146679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.147111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.161575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:49.164002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:49.171386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.171841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.172635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.173077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.205502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4eb14151-b416-4398-94da-f6170e665f06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048137 Aug 02 10:28:49.206091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 648/1305] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:49.288571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:49.296941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-247c0df3-167c-4ddc-be46-d54990e062ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.163429 Aug 02 10:28:49.297428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 658/1306] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:49.608545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:49.610647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:49.616901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.617343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.618108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.618535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.648802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34047781-34d6-4c00-a027-b17c0d596fe0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Aug 02 10:28:49.649858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 649/1307] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:49.734806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:49.737035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:49.743239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.743685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.744455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:49.744907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:49.773496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2aea8ad7-c0f6-4235-b5b3-6bc3e9562b5c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Aug 02 10:28:49.774630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 659/1308] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:50.218370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:50.220532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:50.227622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.228071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.228834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.229264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.232831 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:50.259121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5476e65e-d72f-45e8-854d-205a3095c91b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044827 Aug 02 10:28:50.259718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 650/1309] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:50.318635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:50.319244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:50.325871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.326313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.327077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.327539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.461375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:50.469532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3a3b45f6-9de9-4f21-89a7-4051a631c679 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154706 Aug 02 10:28:50.470034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 660/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:50.661423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:50.663600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:50.670372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.670816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.671608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.672044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.701238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9a425f3b-37e2-4948-88eb-e7786b1ddcb1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Aug 02 10:28:50.701795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 651/1311] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:50.786245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:50.788447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:50.794525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.794965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.795755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:50.796187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:50.829460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c6367e5e-0e88-4484-886e-4a4e51ef403c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047245 Aug 02 10:28:50.830006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 661/1312] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:51.271829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:51.274462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:51.281006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.281471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.282207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.282640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.311940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac54fbfa-e10e-49ff-81bb-45851f5102e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044000 Aug 02 10:28:51.312421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 652/1313] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:51.491401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:51.492007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:51.498466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.498907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.499684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.500115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.632132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:51.640178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4074db17-6c8d-4192-982b-96b69e54c02e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152630 Aug 02 10:28:51.640747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 662/1314] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:51.714740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:51.717048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:51.719011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:51.724090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.724530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.725304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.725747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.757269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-789635c9-8cc4-4306-bc2c-c31f14a9c43e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Aug 02 10:28:51.757840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 653/1315] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:51.841795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:51.843940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:51.850258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.850726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.851517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:51.851948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:51.882127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1b3c9c56-6ae9-456d-a5fb-d67488a68789 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Aug 02 10:28:51.882694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 663/1316] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:52.324770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:52.327047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:52.334320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.334772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.335602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.336166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.370871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0db57704-9bba-4c18-bf98-5dcb345d3272 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050664 Aug 02 10:28:52.371508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 654/1317] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:28:52.662365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:52.663031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:52.669687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.670126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.670883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.671345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.769805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:52.772313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:52.778829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.779306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.780091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.780547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.811649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:52.813153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-579356a0-2b56-4fd4-9148-fcc6d5bdc437 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 Aug 02 10:28:52.813983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 655/1318] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:52.820049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d68b781e-c0d9-4f7f-a37c-d6e130e3239a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161582 Aug 02 10:28:52.820635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 664/1319] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:52.895337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:52.897585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:52.903887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.904331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.905104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:52.905530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:52.938252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2918615a-9ab7-499b-9d9a-e27b003ea4fc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 02 10:28:52.938838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 656/1320] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:53.383471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:53.385827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:53.392084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.392535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.393310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.393747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.432796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e06516c-0651-4bd7-be3e-d97fda9cf477 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053335 Aug 02 10:28:53.433370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 665/1321] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:53.826209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:53.828615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:53.835083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.837425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.837425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.837425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.842695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:53.843688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:53.850130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.850864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.851719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.852633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.887136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13505eb0-1f63-4c18-89c4-083470a4cdc5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064935 Aug 02 10:28:53.887858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 657/1322] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:53.951451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:53.953642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:53.960482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.960848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.961706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:53.962138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:53.995892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:53.999392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2298fb9e-4167-4b59-a6c3-22030b33c1bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052020 Aug 02 10:28:54.000096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 658/1323] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:54.007012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cf55b579-e448-4e56-911b-d1e8b3261ef8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.168292 Aug 02 10:28:54.007625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 666/1324] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:54.445376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:54.448261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:54.454341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:54.454778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:54.455567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:54.455996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:54.486674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25d50d3b-bb95-4b19-8edf-8648a8dd3d8f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045245 Aug 02 10:28:54.487262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 659/1325] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:54.900109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:54.902358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:54.909112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:54.909553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:54.910323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:54.910753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:54.947734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-467e5857-4323-4156-bfba-46ff053b5130 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051576 Aug 02 10:28:54.948367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 667/1326] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:55.012111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:55.014306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:55.020928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.021372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.022158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.022585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.029157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:55.029764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:55.035783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.036221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.036979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.037409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.057759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f3e57e02-004c-4c3a-99f9-9759f2632289 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Aug 02 10:28:55.058369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 660/1327] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:55.176525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:55.184325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75248443-39b3-4393-916d-7ce3cbc62510 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.159014 Aug 02 10:28:55.184927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 668/1328] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:55.500573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:55.503127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:55.509296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.509930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.510714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.511216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.542748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-110aac7f-cb01-40a2-9af6-db0323d19495 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046758 Aug 02 10:28:55.543380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 661/1329] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:55.960363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:55.963030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:55.969931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.970381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:55.971160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:55.971643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.001598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ac57377-8f0e-44a7-afce-5787e8a4b777 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 02 10:28:56.002346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 669/1330] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:56.070342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:56.073187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:56.079855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.080299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.081067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.081503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.110668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-82fd4ff0-3899-4257-b422-994c32e22a1d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Aug 02 10:28:56.111242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 662/1331] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:56.205881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:56.206492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:56.213164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.213553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.214310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.214751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.345427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:56.348850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:56.353362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cfe409b5-5997-428f-8773-575ea579a21f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151354 Aug 02 10:28:56.354981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 670/1332] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:56.555810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:56.557988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:56.564077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.564531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.565292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:56.565730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:56.594484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-44e618da-f74e-414d-ae11-04df60fa4f60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043191 Aug 02 10:28:56.595027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 663/1333] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:57.014080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:57.016266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:57.023502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.023949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.025255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.025686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.057112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-70707ee7-48f8-473c-97da-a2102693e9af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046997 Aug 02 10:28:57.057684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 671/1334] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:57.122794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:57.124975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:57.131977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.132439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.133206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.133701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.164281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a94902f-7f52-4e41-842b-8477449b4fee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Aug 02 10:28:57.165459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 664/1335] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:57.374176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:57.374757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:57.381294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.381736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.382500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.382935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.519232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:57.527787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-213a015c-daac-43e8-91db-c6e649fb80cb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157644 Aug 02 10:28:57.528363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 672/1336] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:57.608684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:57.610846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:57.616998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.617617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.618387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:57.618823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:57.648566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-59bdc763-1822-4464-85cc-108474059bb4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043850 Aug 02 10:28:57.649630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 665/1337] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:58.069663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:58.072466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:58.079471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.079916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.080687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.081115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.111647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6cabbf22-bb94-411d-83a1-42d8ff9f1cbb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Aug 02 10:28:58.112385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 673/1338] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:58.177263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:58.179481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:58.188073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.188517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.189285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.189711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.215321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:58.221604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d99f391-58ba-4246-acef-b2ff33a30de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Aug 02 10:28:58.222185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 666/1339] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:58.549699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:58.550313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:58.556752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.557198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.557968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.558518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.663136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:58.665947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:58.672298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.672740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.673531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:58.673970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:58.702280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:58.709769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b01ee195-39e1-46c7-94a1-6c3f66725a22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051881 Aug 02 10:28:58.710159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81111354-8e4c-408f-b0e2-fe7da0d0b5d1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164261 Aug 02 10:28:58.710351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 667/1340] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:58.710856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 674/1341] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:59.125048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:59.127469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:59.134124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.134565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.135359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.135786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.165543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3aec40cc-8e36-4abc-8b2a-b51e884cc708 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Aug 02 10:28:59.166110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 668/1342] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:59.242252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:59.245030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:59.251884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.252324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.253089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.253538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.283830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4606dfbf-4906-4b48-a9d7-617e1795e233 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Aug 02 10:28:59.284406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 675/1343] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:59.723038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:59.725280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:59.732736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.732974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:59.733179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.733491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:59.733954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.734471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.740397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.740846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.741653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:59.742091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:59.766045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a315f515-4d90-45c0-85ff-1fe57332cf24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047442 Aug 02 10:28:59.766637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 669/1344] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:28:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:28:59.878920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:59.886749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7eb57c54-c846-4a4b-9525-acdabf0848f4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157806 Aug 02 10:28:59.887355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 676/1345] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:59 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:00.178041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:00.180148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:00.186720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.187146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.187953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.188384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.220486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-09082c3b-d0a5-4afd-b187-1806269428d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 02 10:29:00.221067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 670/1346] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:00.297046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:00.299359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:00.306189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.306634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.307445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.307906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.337665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cd0edb1d-ec46-4e95-86a0-fbd2568f0ebe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Aug 02 10:29:00.339821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 677/1347] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:00.779693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:00.782257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:00.790510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.790877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.791697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.792139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.823411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d0651117-9d25-43da-8521-9902098e4943 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047839 Aug 02 10:29:00.823999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 671/1348] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:00.908196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:00.908804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:00.915598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.916066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:00.916819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:00.917246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.050764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:01.058496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-101b88f0-d43a-471b-815d-1c7492d21374 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154199 Aug 02 10:29:01.059058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 678/1349] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:01.233249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:01.235424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:01.241591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.242032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.242813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.243258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.273729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a0766edb-ba51-42e9-8651-e07e3c9001f5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Aug 02 10:29:01.274931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 672/1350] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:01.349717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:01.351858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:01.359127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.359605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.360384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.360818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.396423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-33cd52b5-7143-481f-86ad-00cfd4365e2e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Aug 02 10:29:01.397003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 679/1351] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:01.836468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:01.838712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:01.845681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.846131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.846914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:01.847382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:01.881383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-998499be-ce86-4098-bf3b-1b9bcd42c942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049079 Aug 02 10:29:01.881972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 673/1352] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:02.080080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:02.080682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:02.087010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.087414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.088195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.088600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.225975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:02.234589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-95c8ec7b-7044-472d-af3c-4748cd268630 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158620 Aug 02 10:29:02.235372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 680/1353] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:02.287332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:02.289494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:02.296330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.296768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.297630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.298060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.328661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-21d4a355-5342-4259-aac6-ff458b000de9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045360 Aug 02 10:29:02.329220 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 674/1354] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:02.411115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:02.413241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:02.416160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:02.420938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.421387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.425456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.425456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.451131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e0aeb6de-6531-4982-8457-7a396b596294 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Aug 02 10:29:02.451886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 681/1355] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:02.894238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:02.896475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:02.903048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.903532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.904299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.904737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.934851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-90406a65-78e3-436a-9276-dfb9dbf4af12 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044713 Aug 02 10:29:02.935459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 675/1356] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:03.256798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:03.257473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:03.263738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.264188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.264960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.265394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.341696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:03.343878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:03.350036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.350490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.351294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.351734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.387788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ae5ee273-3e85-4816-8424-1842e0357395 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050081 Aug 02 10:29:03.388390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 676/1357] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:03.405964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:03.413775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2d3480f-8cbb-44d7-965e-8e94483b2ba8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.160829 Aug 02 10:29:03.414472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 682/1358] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:03.464274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:03.466420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:03.472477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.472925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.473684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.474118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.502326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-95df0dfa-3f6b-422a-ab5f-721e2610ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Aug 02 10:29:03.502883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 677/1359] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:03.947862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:03.949948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:03.956635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.957054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.958190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:03.958981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:03.990157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f21125b3-6c09-4417-bb5c-d9a31d4e0d99 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046478 Aug 02 10:29:03.990717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 683/1360] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:04.399286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:04.401499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:04.408275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.408722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.409496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.409930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.436100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:04.436785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:04.441527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5781b37b-1356-44a6-ad14-2458d8f52d0c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Aug 02 10:29:04.442123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 678/1361] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:04.442869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.443355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.444175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.444563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.514383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:04.516656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:04.522880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.523365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.524659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:04.525208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:04.559529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7e1dba0-7012-4ab0-807d-810d48fb3f9d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Aug 02 10:29:04.560097 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 679/1362] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:04.578340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:04.585966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d607c808-3a86-49af-b6f2-20636f4da0fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153863 Aug 02 10:29:04.586533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 684/1363] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:05.002583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:05.004774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:05.012314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.014951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.014951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.014951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.043806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2a831967-850e-4a74-8517-7699ca42c387 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045439 Aug 02 10:29:05.044289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 680/1364] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:05.454085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:05.456209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:05.462718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.463174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.463975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.464412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.492535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-778063c8-6615-4345-ba0a-1acb95f89b54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Aug 02 10:29:05.493607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 685/1365] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:05.571791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:05.573936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:05.580429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.580870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.581626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.582062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.609194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:05.609811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:05.610937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-10dd42c6-3b06-430b-a107-e6513dfcfe9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Aug 02 10:29:05.611551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 681/1366] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:05.616161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.616873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.618990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:05.619538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:05.747493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:05.755512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bb1ba3f3-2e67-4ac9-b501-c9ca6e86b1d8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150150 Aug 02 10:29:05.756070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 686/1367] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:06.057033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:06.059171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:06.065515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.065951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.066763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.067238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.098157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e07a03d-bd07-41bb-83c8-f225844a2075 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Aug 02 10:29:06.098799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 682/1368] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:06.505866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:06.508086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:06.515449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.515904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.516688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.517129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.536160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:06.549838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a0ce5ee5-7130-4646-ae9f-0e3010d25673 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Aug 02 10:29:06.554730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 687/1369] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:06.623749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:06.628887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:06.633057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.634032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.634814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.635285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.650474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:06.666178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0ffb1478-2eef-4d71-9c29-d019bc7b4ead tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Aug 02 10:29:06.666790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 683/1370] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:06.777348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:06.777957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:06.784554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.785005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.785755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:06.786186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:06.931454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:06.939322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b26b98b5-1f24-4242-ba55-245af5cd8a3e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.166583 Aug 02 10:29:06.940206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 688/1371] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:06 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:07.111991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:07.114286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:07.121715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.122165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.122946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.123416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.153163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5d4cf809-ae50-4402-9e12-5cf962368ae0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045270 Aug 02 10:29:07.153723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 684/1372] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:07.564827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:07.567040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:07.573668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.574121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.574898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.575371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.605450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1fa48e94-e21b-4635-81b2-fb422fb3c075 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Aug 02 10:29:07.606034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 689/1373] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:07.678047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:07.680281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:07.686841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.687332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.688101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.688536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.724586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af24999a-814e-4ac6-81c6-b43b1e2bcfd7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050436 Aug 02 10:29:07.725532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 685/1374] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:07.962868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:07.963376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:07.969610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.970046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:07.970810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:07.971266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.104917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:08.112533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-79068609-bca6-4851-b721-796119696f65 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154254 Aug 02 10:29:08.113132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 690/1375] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:08.166577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:08.168778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:08.174847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.175325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.176120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.176535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.207795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d63a663-ca15-45b5-bd28-37cc6abbd447 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Aug 02 10:29:08.208374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 686/1376] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:08.618087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:08.620326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:08.627086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.627565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.628328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.628761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.658926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf090150-6811-4150-a10d-d408d8a4186c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 02 10:29:08.659513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 691/1377] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:08.739686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:08.741822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:08.748596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.749099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.749811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:08.750244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:08.780059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad4cd6c8-8ab9-47fb-ba68-6ef9880fb564 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Aug 02 10:29:08.780623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 687/1378] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:09.134512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:09.135120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:09.141194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.141681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.142400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.142834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.220033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:09.222209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:09.229018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.229465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.230352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.230795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.261148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6315418d-6cad-496a-ab49-9c5ffec4fc00 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045500 Aug 02 10:29:09.261718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 688/1379] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:09.277129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:09.284753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9ef58368-8136-41de-ae9a-9f7d9ce7ef03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154079 Aug 02 10:29:09.285317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 692/1380] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:09.671733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:09.673915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:09.680168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.680651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.681517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.681967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.712755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-62b24461-113b-44b4-9831-ddabfeb96e57 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Aug 02 10:29:09.713360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 689/1381] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:09.792659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:09.794745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:09.801489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.801938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.802718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:09.803157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:09.833602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c7eee380-e003-48e5-b5c9-8e76d9df0660 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Aug 02 10:29:09.834163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 693/1382] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:10.273762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:10.276057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:10.282664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.283114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.283920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.284356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.306568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:10.307234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:10.313617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.314065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.314833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.315290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.315807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5aeee2b6-3931-4bd0-9aab-5599f24202d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046057 Aug 02 10:29:10.316438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 690/1383] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:10.449562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:10.460895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b362e5c4-f667-4b2b-9228-3657a20bcbcb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158770 Aug 02 10:29:10.461478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 694/1384] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:10.725359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:10.728205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:10.734557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.735005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.735803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.736236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.775926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-866d0526-8e1a-4f81-aa28-ea4ca47aac92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054567 Aug 02 10:29:10.776522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 691/1385] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:10.845985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:10.848074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:10.855162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.855640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.856411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:10.856847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:10.886901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-52b5353b-9db8-41d1-ba2c-632eac6f1463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Aug 02 10:29:10.887774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 695/1386] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:11.328448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:11.337892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:11.337892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.338300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.339073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.339539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.370637 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ae849f02-b86f-483e-b433-9e1851b59e49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046117 Aug 02 10:29:11.371080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 692/1387] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:11.483700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:11.484318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:11.490224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.490674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.491556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.491914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.622351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:11.630267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f4623a1a-0999-4bf1-a370-b1c39c599b13 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150479 Aug 02 10:29:11.630836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 696/1388] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:11.790320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:11.792509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:11.798787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.802888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.802888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.802888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.831296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3701a0dd-4efa-42a2-ac2b-daa1d84911c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Aug 02 10:29:11.831895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 693/1389] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:11.899624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:11.901719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:11.908541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.908992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.909767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:11.910207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:11.941202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e8e8d08e-148c-4a18-a32a-3059ffb55ada tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 02 10:29:11.941758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 697/1390] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:12.383291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:12.386155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:12.392843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.393289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.394058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.394492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.424484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ae33cba-e0a4-4e1d-9467-0c2e33aa84d2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 Aug 02 10:29:12.425041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 694/1391] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:12.653705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:12.654241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:12.670043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.670844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.672277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.673066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.816476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:12.825123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ef5f2791-1607-4f0a-9e28-66949b4f79ea tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.176086 Aug 02 10:29:12.825723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 698/1392] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:12.843662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:12.845873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:12.852066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.852512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.853285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.853747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.883525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd5b1cbf-996c-44d7-b245-536f456af606 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Aug 02 10:29:12.884708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 695/1393] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:12 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:12.953754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:12.955958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:12.963052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.963519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.964309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:12.964736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:12.994580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6589fcd2-c291-458d-ab70-88b2c9bb809d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Aug 02 10:29:12.995139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 699/1394] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:13.437963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:13.440171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:13.447525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.447974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.448764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.449199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.482880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5407585d-cf63-405c-b909-d4e488a2ffc6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048990 Aug 02 10:29:13.483510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 696/1395] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:13.846850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:13.847490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:13.854380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.854828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.855643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.856074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.896136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:13.898454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:13.905811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.906253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.907032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.908245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.942561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b052777-3a94-4f26-b1b1-aeaac7448119 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Aug 02 10:29:13.943140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 697/1396] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:14.003963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:14.007405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:14.009765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:14.012425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-20dbd497-8e9f-4810-8bc4-56df674e730e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169380 Aug 02 10:29:14.013090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 700/1397] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:14.018312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.018755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.019561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.019991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.057526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4882711c-e5e5-484d-af73-69752bf7dd53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054982 Aug 02 10:29:14.058383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 698/1398] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:14.495629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:14.497815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:14.504726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.505089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.505855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.510808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.537761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbba548d-d048-47e0-a8f9-4cfde5fec46c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046662 Aug 02 10:29:14.538328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 701/1399] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:14.954148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:14.956269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:14.962910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.964758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.964758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:14.964758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:14.994661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4dc53644-c98b-4257-9b10-9527c2340ed2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Aug 02 10:29:14.995246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 699/1400] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:15.035801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:15.036561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:15.043307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.043749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.044511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.044944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.070121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:15.072316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:15.078347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.078785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.079573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.080005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.082472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:15.110620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad16f808-a311-49e2-878c-45fa7ebea288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Aug 02 10:29:15.111216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 700/1401] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:15.176212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:15.183707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2320e348-a06f-443e-b88c-22fccc72f473 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151993 Aug 02 10:29:15.184262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 702/1402] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:15.551017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:15.553211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:15.559660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.560104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.560868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.561304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.591697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ddabb08b-821d-4779-bc47-d8d1a7956deb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044677 Aug 02 10:29:15.592249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 701/1403] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:16.007658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:16.009952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:16.016853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.017295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.018068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.018498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.048455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-faa4d4ca-33eb-40bc-a75b-0a13a0d6933d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Aug 02 10:29:16.049189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 703/1404] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:16.122967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:16.125121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:16.131989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.132431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.133184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.134128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.162811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d9018ea-745c-4294-b2c4-dd7562fa8d09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 02 10:29:16.163400 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 702/1405] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:16.207250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:16.207861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:16.214632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.215071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.215892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.216324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.220330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:16.346207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:16.354481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6e674ccf-40d6-458d-9d54-cb2abcf3dca2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151115 Aug 02 10:29:16.355041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 704/1406] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:16.605017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:16.607138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:16.609186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:16.614511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.617325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.617325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.617325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.648036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eabddae0-4bae-4ab9-8fdd-24c3404064ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047739 Aug 02 10:29:16.651644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 703/1407] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:17.060308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:17.062458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:17.068976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.069425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.070191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.070628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.100618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c26b40a8-46d3-4ca4-9525-ad77b96149f8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Aug 02 10:29:17.101169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 705/1408] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:17.175581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:17.177724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:17.184532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.184980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.185746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.186186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.219238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c9541c3c-2407-4ef1-b4e5-6df3a1f5c4a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Aug 02 10:29:17.219834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 704/1409] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:17.377019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:17.377562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:17.383554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.384561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.385317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.385748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.517254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:17.524720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b2b7b096-4537-4801-a7a2-5f5059ae4084 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151976 Aug 02 10:29:17.525276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 706/1410] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:17 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:17.661337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:17.663480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:17.669987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.670425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.671176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.671639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.700470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4d577b6b-25c5-4a72-9e4d-b1d06039f9d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043227 Aug 02 10:29:17.701017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 705/1411] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:18.113008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:18.115219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:18.121730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.122180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.122956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.123422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.152866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-48ab1b32-93b5-4e0f-8ba8-12deb113d4a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Aug 02 10:29:18.153420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 707/1412] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:18.233013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:18.235145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:18.241647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.242093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.242911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.243323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.271581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-151fb4f0-ecb9-4c3c-adc8-d75391e9b806 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Aug 02 10:29:18.272128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 706/1413] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:18.698287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:18.698895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:18.704895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.705342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.706109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.706543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.712796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:18.714984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:18.721162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.721601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.722379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.722815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.753714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-df38d955-0da0-4be6-9c0f-297a9787a73a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044817 Aug 02 10:29:18.754281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 707/1414] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:18.840561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:18.848221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fa485f2f-bb97-44e3-a0cb-b38b89c8bdf4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.305987 Aug 02 10:29:18.848788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 708/1415] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:19.165875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:19.168135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:19.174199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.174640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.175423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.175851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.205464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-170f46b3-6b6f-4913-9417-a090e8ae02cb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Aug 02 10:29:19.206113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 708/1416] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:19.284387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:19.286651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:19.293752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.294193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.294955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.295425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.326668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bd170c2a-3068-489f-b636-fdeca7e5b284 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 02 10:29:19.327145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 709/1417] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:19.766456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:19.768720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:19.776429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.776879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.777674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.778114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.811225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7c105082-d3e4-480a-9838-598060f0bd97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048902 Aug 02 10:29:19.811832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 709/1418] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:19.870666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:19.871402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:19.878300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.878742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.879539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.879971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.010892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:20.018523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8da2a5d-e7a8-4268-a945-61cfed066c97 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152352 Aug 02 10:29:20.019016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 710/1419] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:19 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:20.218557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:20.220716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:20.227048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.227535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.228300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.228737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.258006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-631a954b-e85b-40d1-9d3b-1a57ea99a7b5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043407 Aug 02 10:29:20.258557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 710/1420] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:20.339306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:20.341375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:20.347906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.348346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.349110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.349540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.378641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-33d18878-bf8d-44fc-9f08-01eaa2ac733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 02 10:29:20.379198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 711/1421] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:20.824497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:20.826706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:20.833879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.834108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.834879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.835383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.865505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb4ba66f-e314-4e7e-8909-84a548488c48 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045547 Aug 02 10:29:20.866071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 711/1422] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:21.041037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:21.041676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:21.048075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.048519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.049286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.049721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.187597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:21.195158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-718cc033-507f-450e-8337-ecb2c48c52f7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157991 Aug 02 10:29:21.195764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 712/1423] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:21.270139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:21.272366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:21.278450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.278891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.279690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.280121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.310027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34448c14-6c48-4a1f-bd0e-e7ec147c7da5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Aug 02 10:29:21.310571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 712/1424] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:21.391754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:21.393433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:21.400193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.400636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.401413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.401842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.452066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b4b8d03-804f-4f8b-b171-54d2c277d6ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064574 Aug 02 10:29:21.453096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 713/1425] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:21.878410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:21.880631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:21.887940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.888390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.889167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.889605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.919916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de06fea7-d6a5-4919-917b-808775dee937 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045755 Aug 02 10:29:21.920535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 713/1426] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:22.217512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:22.218024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:22.224172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.224614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.225368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.225801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.322582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:22.324756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:22.331274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.331726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.332508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.332937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.361545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:22.364460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b2f631e-9184-48b7-8be9-a6574c689caa tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Aug 02 10:29:22.365052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 714/1427] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:22.369987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3eab18ac-1ac7-433f-8d37-f5c3dacd68e6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156451 Aug 02 10:29:22.370549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 714/1428] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:22 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:22.465196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:22.467417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:22.473959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.474314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.475105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.475574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.507245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d0d77991-4561-4536-9c2c-010fb1723689 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Aug 02 10:29:22.508061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 715/1429] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:22.933348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:22.938812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:22.945707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.946201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.946977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:22.947444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.976101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7edc016f-bd37-4d39-b773-e7b545dfaa7b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047586 Aug 02 10:29:22.976618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 715/1430] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:23.377883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:23.380071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:23.386995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.387497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.388277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.388777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.391795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:23.392434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:23.398292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.398733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.400071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.400502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.414592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:23.420037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-38a7e224-0c3e-4eaf-b3b2-75b764f21214 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046418 Aug 02 10:29:23.424891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 716/1431] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:23.523956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:23.528412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:23.541793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.542502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.543872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.544646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.547793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:23.555709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-90813da9-8c5d-4832-b933-21397b934a63 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.167586 Aug 02 10:29:23.556291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 716/1432] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:23.575093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b2a3d469-dceb-4cb0-b683-a5f744054870 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058462 Aug 02 10:29:23.575709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 717/1433] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:23.988937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:23.991102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:23.998308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.998752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.999551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.999981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.030645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ef7606c9-c5f1-4cca-aeba-3cc4da9ce5a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045728 Aug 02 10:29:24.031224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 717/1434] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:24.433023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:24.435171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:24.441286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.441779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.442542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.442972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.472947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5936c5ca-86c1-471d-a500-af90a7cd0827 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 02 10:29:24.473532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 718/1435] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:24.577878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:24.578475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:24.584608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.585044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.585800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.586232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.587767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:24.589999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:24.596511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.596962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.597744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.598181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.630469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e55559a3-226f-44f0-939b-0de68c7fc199 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Aug 02 10:29:24.631053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 719/1436] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:24.717216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:24.724823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a89cf435-e328-49c3-aedf-0cb244a5afb5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.150920 Aug 02 10:29:24.725397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 718/1437] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:25.043909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:25.046087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:25.052307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.052756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.053531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.053967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.084592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-897ec6a6-14d2-44e0-ade6-29d08a7e5a50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045298 Aug 02 10:29:25.085146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 720/1438] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:25.486285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:25.488480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:25.495695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.496137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.497078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.497512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.528420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9df2e1cd-1cd8-4047-a648-a001d11072f0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Aug 02 10:29:25.528985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 719/1439] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:25.643008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:25.645177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:25.652247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.652687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.653436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.653866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.682669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9f0b9902-a4d9-455a-a763-624d9f2edd0c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Aug 02 10:29:25.683252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 721/1440] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:25.746848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:25.747409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:25.753850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.754300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.755069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.755534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.886267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:25.889676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:25.894034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f695557b-e64b-4bb7-9635-1c48ead18cfd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151265 Aug 02 10:29:25.894596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 720/1441] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:26.097223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:26.099552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:26.105807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.106246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.107009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.107473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.138900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da690e76-9c68-4d1c-a687-2e4ccb109579 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 Aug 02 10:29:26.139620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 722/1442] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:26.544667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:26.546826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:26.553785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.554234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.555018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.555491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.589245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-71ebdb46-d0f0-45b2-b495-50f870342498 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049607 Aug 02 10:29:26.589824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 721/1443] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:26.694470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:26.697354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:26.704164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.709647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.709647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.709647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.737672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3260d687-43dc-47bd-8744-5a19b53af7c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047466 Aug 02 10:29:26.738242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 723/1444] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:26.917268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:26.917788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:26.923821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.924295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.925048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.925482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.063736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:27.071401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-51ef9050-8ae6-4450-9eff-f99a5cf4a178 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158760 Aug 02 10:29:27.071969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 722/1445] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:27.152585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:27.154798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:27.160922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.161362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.162122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.162547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.191919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7291f822-e394-4d36-aa2b-24c2726445af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044213 Aug 02 10:29:27.192364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 724/1446] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:27.601709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:27.603963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:27.610556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.611002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.611831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.612264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.643003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-70584349-5157-498d-8206-804d65f2466c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Aug 02 10:29:27.643640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 723/1447] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:27.750538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:27.753023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:27.761519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.762040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.763025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.763492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.794447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46a593cd-2ed4-4cb0-96b2-d67b2df4805a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047707 Aug 02 10:29:27.794936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 725/1448] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:28.093256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:28.093771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:28.100034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.100489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.101263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.101697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.208141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:28.210605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:28.217506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.217961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.218748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.219216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.237034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:28.244949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4c47e1a9-5a9c-45bc-9f7d-ac4fea7a4e73 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155652 Aug 02 10:29:28.245530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 724/1449] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:28 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:28.250918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-136fdd32-921e-4233-b0c8-bfda3eb9671f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050052 Aug 02 10:29:28.251877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 726/1450] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:28.656057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:28.658257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:28.664822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.665273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.666050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.666517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.697165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1acf689e-efb9-4674-8461-694efda36f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Aug 02 10:29:28.697742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 725/1451] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:28.807098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:28.809222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:28.815910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.816356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.817126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.817564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.846730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61bd2723-c48c-4bc3-926c-40f86bf9bd13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Aug 02 10:29:28.847313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 727/1452] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:29.263939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:29.266118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:29.272516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.272958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.273724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.274155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.275733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:29.276474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:29.283919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.284484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.285484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.286020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.309479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-860357d9-c2f6-4b7d-a63b-a9cf2be94db4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049562 Aug 02 10:29:29.310249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 726/1453] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:29.425803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:29.433820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b88cc5b3-158f-45e5-afb5-a4146ec48af1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.163636 Aug 02 10:29:29.434433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 728/1454] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:29.714900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:29.717032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:29.723909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.724346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.725118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.725545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.756747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac250e6a-a908-42d8-9c91-541f08e686e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046722 Aug 02 10:29:29.757380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 727/1455] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:29.860114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:29.862428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:29.870667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.871286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.872159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:29.872682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.902550 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c0be59d-0eb5-49d8-9994-aa3d8e81315a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046601 Aug 02 10:29:29.903113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 729/1456] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:30.322874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:30.325098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:30.331323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.331769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.332529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.332959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.364085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cdc1cd7a-c806-426f-ac04-e5dcd8183a03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045969 Aug 02 10:29:30.364646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 728/1457] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:30.462743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:30.463414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:30.469478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.469921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.470680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.471114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.607816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:30.616315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe1d1caa-7969-4d33-9e30-f67f6821a933 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158089 Aug 02 10:29:30.616898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 730/1458] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:30.769942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:30.772217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:30.779706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.780202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.781043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.781529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.815447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f526a4be-ae53-4cc9-9dcd-6bb702c65f0d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049552 Aug 02 10:29:30.816164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 729/1459] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:30.914832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:30.917324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:30.924934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.925373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.926169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.926646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.962156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-774831fc-26cc-4fc2-881f-71727cc721c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051436 Aug 02 10:29:30.962758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 731/1460] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:31.377953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:31.380117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:31.386239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.386674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.387469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.387896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.418845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8889ce48-bdf2-4294-bcbc-35eb45ef7b26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045756 Aug 02 10:29:31.419470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 730/1461] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:31.638596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:31.639109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:31.645310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.645752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.646518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.646948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.788083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:31.796789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-015a78c3-2b4a-4ff6-858b-b36d977814bd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162177 Aug 02 10:29:31.797365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 732/1462] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:31.828725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:31.830914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:31.833283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:31.838124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.838566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.839369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.839802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.872626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-301c06e0-943a-4238-bdad-d121aed967e7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Aug 02 10:29:31.873440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 731/1463] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:31.974493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:31.976680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:31.984060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.984558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.985342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.985780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.002103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:32.020928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63820b3b-00cc-480b-974c-e3ff3a079311 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050517 Aug 02 10:29:32.021538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 733/1464] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:32.435635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:32.437996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:32.444846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.445290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.446079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.447126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.479848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b0e98ed-04d1-48fe-88a3-6928f6435b06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049390 Aug 02 10:29:32.480446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 732/1465] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:32.834266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:32.835365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:32.843203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.843662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.844433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.844858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.886003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:32.888213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:32.895107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.895607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.896383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.896821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.929081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-19fa1c34-db6a-4111-9191-1b36d7fecf54 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Aug 02 10:29:32.937499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 733/1466] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:32.990606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:32.999383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-79b235e4-9124-4ebd-abe5-2e95de67c524 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.172363 Aug 02 10:29:32.999971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 734/1467] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:33.035499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:33.037734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:33.045900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.046403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.047285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.047914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.082099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-60ad9d14-49ec-4c8c-a993-37825de09b09 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Aug 02 10:29:33.082683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 734/1468] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:33.493091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:33.495315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:33.501900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.502342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.503430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.503867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.537019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3dae615-d87b-4a17-8887-f408680919b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048168 Aug 02 10:29:33.537597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 735/1469] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:33.945494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:33.947831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:33.955261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.955762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.956576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.957020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.992784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75dd4f4e-c365-43ec-bcd8-080bc826f472 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051234 Aug 02 10:29:33.993904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 735/1470] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:34.023451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:34.024339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:34.034196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.034973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.035962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.036692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.096540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:34.099348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:34.107885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.108522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.109815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.110479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.150251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c433116-a134-4ee9-98b3-5ddf27d5fd5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059110 Aug 02 10:29:34.150926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 736/1471] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:34.209820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:34.221908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9f962cfe-985b-491d-810d-73475ae8e0c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.204460 Aug 02 10:29:34.222901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 736/1472] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:34.549897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:34.552216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:34.558757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.559236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.560042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.560481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.579003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:34.593737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ea4df8c-39fe-4450-848e-d405964be439 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047948 Aug 02 10:29:34.594327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 737/1473] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:35.007694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:35.010577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:35.017010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.017455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.018241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.018678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.050490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ffa4d29a-baf1-4bf6-97d6-159a9ac4edf7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048098 Aug 02 10:29:35.051313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 737/1474] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:35.169992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:35.173517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:35.186045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.186820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.188134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.188888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.222955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0df0c45e-0f48-4d26-a037-4cadbfd4e301 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061011 Aug 02 10:29:35.223629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 738/1475] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:35.258558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:35.259270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:35.265503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.265940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.266708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.267154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.429829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:35.437661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d7ed493b-be61-491d-80ec-4bdc5b077cf5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.183166 Aug 02 10:29:35.438240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 738/1476] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:35.607353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:35.609631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:35.616506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.616963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.617766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.618214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.652158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-deda5be6-6fd1-4664-aec0-8ee72bd41c89 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049515 Aug 02 10:29:35.652756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 739/1477] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:35.900741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:29:35.901076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:29:36.063717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.066151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.074266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.074711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.075562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.076001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.107996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-92e21442-98c3-4bf5-843b-1a9656bb2959 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048448 Aug 02 10:29:36.108567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 739/1478] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:36.236381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.238558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.246471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.246916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.247731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.248169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.280736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9982a4fe-2b19-4bcc-9af7-ed40ed0773c6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Aug 02 10:29:36.281327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 740/1479] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:36.460097 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.460720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.468151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.468599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.469388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.469826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.609502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:36.617551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-347797aa-834c-45a3-8c75-673f065d0be2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161693 Aug 02 10:29:36.618171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 740/1480] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:36.665250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.667455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.673753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.674206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.674995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.675469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.707665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-593943e6-3f10-4196-9226-d50f9dc1c44a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046547 Aug 02 10:29:36.708276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 741/1481] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:37.122032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:37.126253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:37.132263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.132708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.133489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.134586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.166678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-73457e9f-41e2-4be8-8c6b-5d02b5bcb30d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Aug 02 10:29:37.167438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 741/1482] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:37.294657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:37.297017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:37.304381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.308394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.308394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.308394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.341144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-970fa95c-7e46-4467-b25c-399a0ae73816 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051300 Aug 02 10:29:37.341650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 742/1483] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:37.640465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:37.640980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:37.647182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.647665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.648445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.648879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.722144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:37.724536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:37.731072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.731637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.732482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.733143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.774642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e4aeef6c-f965-46ba-9f8c-dd8d41bf9c69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056883 Aug 02 10:29:37.775705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 743/1484] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:37.808588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:37.816570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-16ff720c-73f0-41d8-988f-06932849cb8b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.180149 Aug 02 10:29:37.817143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 742/1485] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:38.179459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.181716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.187877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.188318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.189113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.189540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.222497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f0d6205a-f941-4106-93a9-3dbdc0ed5318 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047038 Aug 02 10:29:38.223068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 744/1486] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:38.356698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.358916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.366185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.366633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.367453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.367890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.401482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-905aab1b-2663-4dca-b423-d6d8c7eac72c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049329 Aug 02 10:29:38.402069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 743/1487] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:38.788586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.790743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.797435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.797879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.798648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.799081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.828628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac39d476-c11a-4810-b741-7a5b73e84b98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Aug 02 10:29:38.829200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 745/1488] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:38.839633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.840247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.846438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.846885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.847699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.848135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.990799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:38.999094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-982704fa-11fe-424a-9de8-9a80097ebff3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164023 Aug 02 10:29:38.999690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 744/1489] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:39.235010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.237272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.243529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.243981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.244756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.245200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.277329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56eb0c0e-0da0-4ac4-b2d2-14eec90d5fb4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Aug 02 10:29:39.277902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 746/1490] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:39.414032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.416443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.423500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.423942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.424715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.425142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.457167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22327386-391c-46e6-99f2-733ee94800b0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 Aug 02 10:29:39.457750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 745/1491] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:39.841027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.843262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.850493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.850942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.851797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.852254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.885141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b743871-b1bc-4cfb-9fc3-ef34b44214e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048649 Aug 02 10:29:39.885729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 747/1492] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:40.020750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:40.021395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:40.028513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.028979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.029752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.030185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.165764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:40.173458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e5ce8bd-251d-413a-b095-47940a1c5d3f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156643 Aug 02 10:29:40.174011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 746/1493] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:40.293330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:40.295447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:40.301648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.302090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.302857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.303324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.332644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ffabda53-50cb-4f66-88fd-08e1f4f25a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Aug 02 10:29:40.333194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 748/1494] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:40.472141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:40.475625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:40.485563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.486002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.486844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.487304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.523827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e44dba34-40fc-4f6b-a748-6e2e67b448db tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056209 Aug 02 10:29:40.524981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 747/1495] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:40.898310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:40.902408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:40.909203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.920487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.920487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.920487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.940320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-58efc3f7-3e75-498e-ba4d-d0ee194a96e8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046077 Aug 02 10:29:40.940906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 749/1496] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:41.195845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:41.196439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:41.202730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.203180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.204036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.204627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.335932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:41.344168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8fb878c2-cfd0-415f-9ead-0a8aa515732c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152375 Aug 02 10:29:41.344682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:41.344828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 748/1497] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:41 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:41.346900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:41.353538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.353984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.354749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.355201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.383332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c005bf23-4630-489d-9a7a-e0b5bd551464 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042488 Aug 02 10:29:41.383879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 750/1498] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:41.538483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:41.541401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:41.548058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.548511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.549283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.549719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.578913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1783ec18-79c0-4dfd-9812-446a83e3bd2c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Aug 02 10:29:41.579514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 749/1499] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:41.953890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:41.955986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:41.963168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.963633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.964387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.964819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.993910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fce7a281-b7eb-4149-b24a-4e2fac4809fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043639 Aug 02 10:29:41.994472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 751/1500] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:42.366310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:42.366927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:42.373608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.374050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.374797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.375250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.377756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:42.395742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:42.398042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:42.404131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.404579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.405350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.405794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.436097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82f01c39-5149-4fe0-8970-9128c302824f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Aug 02 10:29:42.436867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 752/1501] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:42.512316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:42.520237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e525df0f-d823-4f3e-90ac-e6a4a05f676d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158066 Aug 02 10:29:42.520803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:42 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:42.591779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:42.593899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:42.600146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.600598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.601362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.601794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.631672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4ab18a5a-a3f6-4c90-b66e-3cb29a8ea5fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Aug 02 10:29:42.632128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 753/1503] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:43.006562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:43.009410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:43.016075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.016520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.017291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.017722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.048732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-88c094b7-31fe-413e-a2c7-c16b8670ec3f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046527 Aug 02 10:29:43.049300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 751/1504] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:43.448898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:43.450964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:43.457575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.458058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.458815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.459267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.462972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:43.489833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0c51c3cd-ec9a-470d-973c-6faf9f7978a3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Aug 02 10:29:43.490404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 754/1505] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:43.542641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:43.543285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:43.549936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.550376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.551154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.551649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.644856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:43.647161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:43.654060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.654507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.655303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:43.655745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:43.685830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f3d04d38-7610-4c3f-82ad-dddb9054978e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045253 Aug 02 10:29:43.686042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:43.686402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 755/1506] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:43.693776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8e80d0ba-d0ba-4d40-952a-efb4a92e63b5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155719 Aug 02 10:29:43.694332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 752/1507] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:44.063050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:44.065298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:44.071551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.072003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.072809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.073242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.102531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9ead3e86-5429-4557-96a1-a6ae9e717f1e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043875 Aug 02 10:29:44.103087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 756/1508] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:44.502118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:44.504612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:44.506950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:44.511882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.512327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.513112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.513544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.545369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-facd9eac-a9ca-4924-a725-8d5886cd3093 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047192 Aug 02 10:29:44.545922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 753/1509] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:44.698467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:44.700665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:44.706954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.707433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.708199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.708686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.715658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:44.716269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:44.722340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.722783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.723575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:44.724006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:44.738504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-076867b0-0eb9-4f31-8157-4eb69d52cc05 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Aug 02 10:29:44.739034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 757/1510] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:44.851406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:44.859680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a08fe02-3c60-4deb-8907-40f3812fa65d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.148626 Aug 02 10:29:44.860239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 754/1511] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:45.115676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:45.117803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:45.123868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.124310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.125057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.125491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.158518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c995fcb4-377a-465f-bb2b-97aec45ff829 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046821 Aug 02 10:29:45.159079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 758/1512] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:45.558350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:45.560591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:45.567144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.567624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.568388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.568827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.598647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bca3b21a-c228-47c2-b51d-56d550c679d2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 02 10:29:45.599239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 755/1513] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:45.751039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:45.753475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:45.760015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.760460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.761222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.761657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.790198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9f39b6fa-66dc-4c15-8e20-2126b1270986 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Aug 02 10:29:45.790654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 759/1514] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:45.882350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:45.882985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:45.889066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.889513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:45.890275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:45.890710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.025350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:46.032592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f68ed64d-4ec5-4d2d-92c5-d0450ff8905d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154428 Aug 02 10:29:46.033168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 756/1515] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:46.171777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:46.173879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:46.180271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.180733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.181506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.182556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.212520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7be42f0e-4545-43f5-9ff9-a9c0f7fec87e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Aug 02 10:29:46.213112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 760/1516] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:46.611448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:46.613654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:46.620551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.621000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.621785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.622228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.654070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1167fcc6-a97b-4ebf-bcf2-01bbeb0c45ee tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 Aug 02 10:29:46.654628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 757/1517] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:46.802970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:46.805073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:46.811889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.812342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.813122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:46.813557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:46.843202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fa284f2c-2225-4d43-80ef-6b875c594e9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Aug 02 10:29:46.843767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 761/1518] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:47.054112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:47.054634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:47.061349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.061786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.062554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.062984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.196979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:47.205521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c533d34-9e18-4e14-af69-bb018f249f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155299 Aug 02 10:29:47.206101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 758/1519] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:47.225243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:47.227429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:47.233547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.234014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.234776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.235224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.268125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb561abf-81aa-43dc-9540-2eac8ba88115 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047154 Aug 02 10:29:47.268694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 762/1520] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:47.667317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:47.669615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:47.677268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.677715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.678508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.678942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.712524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-807305e7-f82a-4610-bec5-9304b4f13e92 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049900 Aug 02 10:29:47.713108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 759/1521] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:47.856542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:47.858623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:47.865326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.865765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.866530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:47.866962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:47.897398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bae2d52f-b516-4975-a655-efb4d8103ee1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 Aug 02 10:29:47.897980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 763/1522] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:48.227835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:48.228365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:48.235180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.235658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.236473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.236910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.284037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:48.286215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:48.293078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.293972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.295431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.296226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.333043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1899c8f-9b47-4f9a-b5d4-be794c93b6e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052952 Aug 02 10:29:48.333627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 764/1523] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:48.380994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:48.389106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af49912e-cd54-4780-9ec0-4549febedce4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.165340 Aug 02 10:29:48.389665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 760/1524] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:48 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:48.725086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:48.727455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:48.733943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.734395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.735177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.735636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.766769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4fed698d-b85a-4b20-90cb-71744182fd80 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Aug 02 10:29:48.767412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 765/1525] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:48.909628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:48.911802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:48.918486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.918926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.919716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:48.920145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:48.951649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-981742f7-74fa-40b8-9e11-9caa603a5d46 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Aug 02 10:29:48.952202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 761/1526] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:49.345624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:49.347805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:49.354939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.355413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.356174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.356606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.387290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1cc8ae07-ad39-495b-b2c4-df48664013aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045713 Aug 02 10:29:49.387855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 766/1527] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:49.411029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:49.411677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:49.418457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.418907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.419716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.420236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.553112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:49.560801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-27cf314e-5d46-4b20-84d0-9059e7c6934e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153675 Aug 02 10:29:49.561376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 762/1528] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:49.779928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:49.782109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:49.788659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.789103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.789906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.790343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.821095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2f0178a7-3300-4a07-abd1-e96e179ae5bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Aug 02 10:29:49.821666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 767/1529] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:49.964558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:49.967036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:49.975976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.976428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:49.977456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:49.977650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.010537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b35c3288-38fe-4051-97e5-5a8748f67f29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050267 Aug 02 10:29:50.011122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 763/1530] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:50.399041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:50.401802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:50.408589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.409044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.409824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.410264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.442586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ad8a7527-ac24-46bd-a911-127c3b8903e5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047569 Aug 02 10:29:50.443168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 768/1531] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:50.581863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:50.582424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:50.589288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.589737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.590563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.591005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.722740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:50.730497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6c7641c-4e45-4d0f-b9d4-1fc79d60115c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152633 Aug 02 10:29:50.731322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 764/1532] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:50.834092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:50.836177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:50.842890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.843383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.844158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:50.844599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:50.874345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ce91680a-ff7f-480c-be17-55cec9803726 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 02 10:29:50.874907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 769/1533] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:51.023267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:51.025443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:51.032783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.033231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.034001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.034434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.065460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0ea82f92-64b3-4723-8167-220cb536b6da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Aug 02 10:29:51.066024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 765/1534] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:51.456310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:51.458517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:51.465179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.465631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.466519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.466875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.492545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:51.497746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5bbb9a33-477a-40df-b4e5-971c6a7f0157 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045535 Aug 02 10:29:51.498317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 770/1535] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:51.752589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:51.753209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:51.759841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.760911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.761689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.762128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.886784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:51.888986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:51.895582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.896041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.896816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:51.897258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:51.897582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:51.899837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:51.906257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d4e1bd2f-20ff-4fb9-852a-005c0f22d89e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157535 Aug 02 10:29:51.907174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 766/1536] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:51.928188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b483982-9616-4f40-8b61-ff581736d200 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Aug 02 10:29:51.928769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 771/1537] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:52.078946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:52.081086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:52.088927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.089387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.090196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.090635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.122449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5032b3d9-731b-4695-8366-7a39264570d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Aug 02 10:29:52.123033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 767/1538] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:52.511276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:52.513459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:52.520273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.520712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.521480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.521908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.556228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7f2cff48-d4d0-4d0c-9a2c-46922152ca0a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049581 Aug 02 10:29:52.556802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 772/1539] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:52.928243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:52.928770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:52.935990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.936440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.937213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.937645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.941243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:52.943486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:52.949965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.950409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.951388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:52.951642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:52.984767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-364738cc-aab1-47a9-9d77-4a9e0e1e0663 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047268 Aug 02 10:29:52.985646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 773/1540] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:53.077547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:53.085909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-10714738-9dcb-4352-ac64-cb123560aca5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161801 Aug 02 10:29:53.086545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 768/1541] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:53.134324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:53.136591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:53.142778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.143309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.144222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.144727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.175272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78e4ff5e-9cd9-4387-b74f-5667dbcca297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044849 Aug 02 10:29:53.175879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 774/1542] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:53.569003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:53.571218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:53.577867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.578308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.579094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.579549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.609923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea8dcaf9-1e8e-46ed-be76-8c81659043e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045035 Aug 02 10:29:53.610486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 769/1543] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:53.998106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:54.000488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:54.009476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.009889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.011265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.011698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.044834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7aee68c6-cc46-4a01-a834-160ae5ebe5c6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051178 Aug 02 10:29:54.045412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 775/1544] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:54.108775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:54.109375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:54.116206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.116661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.117427 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.118728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.188776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:54.191064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:54.198385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.198844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.199658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.200116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.235945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8f5b29c8-0190-4247-bc85-05259f364ae9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051119 Aug 02 10:29:54.236705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 776/1545] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:54.281013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:54.289237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e3fef84b-bc16-4174-8d56-716f0e679bdd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.184287 Aug 02 10:29:54.289819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 770/1546] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:54 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:54.622906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:54.625141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:54.631478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.631925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.632688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:54.633125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:54.663182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e38adc85-ee2b-4f64-944b-f7b4c44b439b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Aug 02 10:29:54.663755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 777/1547] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:55.057590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:55.059791 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:55.066497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.066942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.067748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.068223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.099598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f18960a-9d8a-426d-a25e-737d2cffa714 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Aug 02 10:29:55.100178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 771/1548] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:55.248873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:55.251111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:55.258466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.258914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.259734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.260175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.293231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6bdad68-dc57-4586-be07-efa594e2b1e3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048975 Aug 02 10:29:55.293803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 778/1549] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:55.315211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:55.315211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:55.318694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.319136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.319925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.320359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.453591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:55.462110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a9e04b92-e50f-42c6-a6cf-a3e97a01463e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154802 Aug 02 10:29:55.462683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 772/1550] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:55.675922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:55.677977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:55.684216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.684664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.685430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.685865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.717509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cdaa7f3-d8f8-420d-b544-8ba861269196 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045679 Aug 02 10:29:55.718306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 779/1551] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:56.113231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:56.115506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:56.122998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.123478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.124258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.124692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.159614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e9c5e125-e0da-4e84-b594-c20113242f59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050339 Aug 02 10:29:56.160190 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 773/1552] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:56.306280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:56.308672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:56.315553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.315994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.316762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.317193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.348699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4e55091a-8ba7-44f1-8ba2-b7e779a506ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046521 Aug 02 10:29:56.349275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 780/1553] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:29:56.484334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:56.484932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:56.491203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.491659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.492442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.492872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.641383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:56.649705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aa599227-37f0-47f1-b0a6-c50500f75d90 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169356 Aug 02 10:29:56.650298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 774/1554] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:56.730476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:56.732758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:56.734717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:56.739654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.740109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.740888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.741329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.772962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf0358ee-043f-41ed-8dc2-0220be2c15ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046693 Aug 02 10:29:56.773544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 781/1555] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:57.172246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:57.174430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:57.181249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.181696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.182972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.183470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.220214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ada28c65-663e-4436-b99f-9dd7db6c5b20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051903 Aug 02 10:29:57.220800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 775/1556] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:57.363156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:57.365394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:57.373182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.373629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.374399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.374836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.404469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ba4cbd06-9a00-4b50-a460-de1c25b2f8f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Aug 02 10:29:57.405035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 782/1557] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:57.672716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:57.673312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:57.679375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.679824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.680591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.681026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.786130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:57.788457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:57.795835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.796367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.797202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.797702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.814949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:57.822460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-84187cec-7cdd-4fe3-b829-8710122cf2d4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153823 Aug 02 10:29:57.823748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 776/1558] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:57.828331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82954d21-cfe1-4f90-94fc-b2851cab4ce6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046162 Aug 02 10:29:57.828881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 783/1559] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:29:58.232940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:58.235370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:58.241944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.242394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.243165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.243636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.273929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b31bd243-d6c3-4dbf-84c0-13208a61d29d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 02 10:29:58.274499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 777/1560] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:58.417346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:58.419639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:58.426176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.426621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.427425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.427861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.457138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b607d4a-b281-4988-8fc8-b05892bbcc31 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Aug 02 10:29:58.457696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 784/1561] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:58.841472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:58.843763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:58.845348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:58.845971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:58.850068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.850513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.851326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.851802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.852034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.852484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.853258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.853811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.884196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-503e775f-fad3-459e-9f51-6313df01ada7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047401 Aug 02 10:29:58.884787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 778/1562] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:29:58.990352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:58.998605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1f144f3f-8e7a-4cb5-bd24-f9a19540a18a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157192 Aug 02 10:29:58.999171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 785/1563] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:59.286402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:59.288658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:59.296172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.296623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.297410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.297851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.332084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11928f6e-98bb-4ea3-aa27-c7fd9af72ced tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Aug 02 10:29:59.332681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 779/1564] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:59.469822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:59.472035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:59.478688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.479819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.480599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.481039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.509819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7dd18c5a-3a60-49e2-8ac6-7187df37e293 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Aug 02 10:29:59.510472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 786/1565] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:29:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:59.896797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:59.898970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:59.905193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.905636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.906403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.906838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.936829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b6c2d63-4739-4547-bc86-f289e7924121 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044092 Aug 02 10:29:59.937397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 780/1566] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:29:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:00.019606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:00.020219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:00.026702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.027145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.027932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.028365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.046539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:00.156364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:00.163823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75d98af0-0ac6-4572-98fc-8ee48173acc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.148192 Aug 02 10:30:00.164381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 787/1567] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:00.345351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:00.347552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:00.354636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.355075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.355854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.356285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.385690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1200d9fb-efff-4ccb-a8d2-d60c68e21961 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Aug 02 10:30:00.386250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 781/1568] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:00.522081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:00.524333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:00.530969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.531457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.532229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.532663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.561950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8b28d4a-3e59-43d7-99e1-46e8292360b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Aug 02 10:30:00.562505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 788/1569] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:00.950000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:00.953163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:00.959413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.959859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.960639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:00.961110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.990355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aa4b5bee-f761-4bad-8f1a-bab4cc540720 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045031 Aug 02 10:30:00.990926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 782/1570] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:01.185469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:01.186065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:01.192162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.192613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.193684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.193829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.328867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:01.336382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f7c5ab8b-4767-4976-b1a9-d7e53c96d35d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.155462 Aug 02 10:30:01.336953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 789/1571] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:01.398301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:01.400499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:01.407325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.407768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.408537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.408972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.423288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:01.441629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc7bf26b-a014-4f18-97c6-c5327afc05dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Aug 02 10:30:01.441629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 783/1572] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:01.574300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:01.576497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:01.583262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.583717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.584495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.584930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.615796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-798f42b6-6c2f-461a-8baa-11a1e80d7958 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Aug 02 10:30:01.616356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 790/1573] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:02.003314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:02.005773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:02.011979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.012419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.013251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.013687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.042695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8bee3b64-2d66-4f15-9fdc-1bbf1ac5459b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043828 Aug 02 10:30:02.043258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 784/1574] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:02.361811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:02.361811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:02.366015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.366457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.367245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.367703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.452809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:02.455085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:02.462128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.463992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.463992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.464353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.498378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0db1b2b7-366f-4411-a279-2df5a04c1b9d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049403 Aug 02 10:30:02.498996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 785/1575] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:02.507411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:02.516040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8451293-e3d7-4869-a51d-8bb6bf17e362 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.160804 Aug 02 10:30:02.516625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 791/1576] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:02.628215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:02.630557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:02.637218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.637658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.638420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.638844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.669028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-644d962c-dc1f-4bae-b1f1-00d255e2297c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Aug 02 10:30:02.669601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 786/1577] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:03.055122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:03.057864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:03.064506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.064958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.065744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.066178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.096042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1bda3a4c-f356-4ba4-b91d-f8decbaa5098 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Aug 02 10:30:03.096598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 792/1578] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:03.511793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:03.514047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:03.520716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.521166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.521935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.522373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.538003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:03.538689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:03.545323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.545845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.546612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.547046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.552572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-73cf62bb-e991-4295-a07e-80da45b4085e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Aug 02 10:30:03.553145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 787/1579] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:03.682817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:03.685122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:03.691666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.692109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.692911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.693342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.700493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:03.708601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc20a045-240c-4d81-9706-46e7deb3ce24 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.174413 Aug 02 10:30:03.709189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 793/1580] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:03.724491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-337b9838-b831-47f6-8e73-35b8c0bb8c2f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Aug 02 10:30:03.725053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 788/1581] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:04.109495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:04.111689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.118422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.118866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.120365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.120794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.149767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9ecd92ae-c0ed-4860-bbb0-2e5ddcaf6236 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044248 Aug 02 10:30:04.150330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 794/1582] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:04.564997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:04.567130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.573656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.574112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.574858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.575321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.605083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-970d2df9-1fa3-471e-a1fd-203afffe725a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Aug 02 10:30:04.605646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 789/1583] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:04.732030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:04.732643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.736532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:04.738829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.739010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.739497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.740277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.740713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.746317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.746317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.746592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.746866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.778018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58139be1-3150-405b-9b63-0be1cb4222d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 02 10:30:04.778599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 790/1584] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:04.880921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:04.889742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5e7b0263-774e-45c0-aad4-ee379018f0d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162143 Aug 02 10:30:04.890323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 795/1585] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:05.162274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:05.164525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:05.171245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.171707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.172481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.172920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.205665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0391aa4-7509-4cc8-8f8c-35d9595f058c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047398 Aug 02 10:30:05.206239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 791/1586] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:05.617910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:05.621045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:05.627898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.628363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.629422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.629865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.662573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-593ab630-f113-4711-9e92-9148efc1614d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048665 Aug 02 10:30:05.663146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 796/1587] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:05.790709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:05.792887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:05.799558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.799999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.800784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.801211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.839730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a5e7949-04b4-4208-9d15-47a6045959f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053161 Aug 02 10:30:05.840312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 792/1588] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:05.911107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:05.911739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:05.918450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.918901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.919714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:05.920146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.052847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:06.061096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-421baa18-014c-4872-acbc-2f48a61a4ec5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153928 Aug 02 10:30:06.061682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 797/1589] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:06.218323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:06.220530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:06.226933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.227426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.228202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.228659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.259426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-269fed58-ae76-4080-b2c2-04e0e05d2b19 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Aug 02 10:30:06.259997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 793/1590] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:06.675294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:06.677496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:06.684823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.685276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.686048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.686491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.717132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c8f40b4-4ca1-4bc5-b275-f8efe8f694b1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Aug 02 10:30:06.717731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 798/1591] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:06.852455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:06.855128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:06.861998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.862435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.863207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:06.863651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:06.893057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3fe9506a-62f9-49e0-b15b-af56f20df13b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Aug 02 10:30:06.893651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 794/1592] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:07.083707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:07.084339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:07.091417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.091870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.092662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.093103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.242350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:07.250729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93147115-e724-482b-b685-f1a55384d44d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.171092 Aug 02 10:30:07.257520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 799/1593] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:07.273072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:07.275288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:07.283475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.283949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.284742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.285182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.316918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-60e350ea-0566-4d1b-b305-1f0ba40aa6b8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047782 Aug 02 10:30:07.317519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 795/1594] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:07.731017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:07.734070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:07.741136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.741621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.742414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.742937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.776535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1f3670c9-c290-4c3d-a651-e9fc60af6b11 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049630 Aug 02 10:30:07.781227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 800/1595] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:07.905745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:07.908068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:07.914855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.916132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:07.917069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:07.953058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3fc669f5-b55f-4289-9640-9c3246edaa41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051381 Aug 02 10:30:07.953652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 796/1596] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:08.272670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:08.273331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:08.279619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.280068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.280856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.281297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.330533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:08.332833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:08.339651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.340090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.340856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.341284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.372808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5a843bb0-40fd-432f-8ff8-d8015846ca84 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046526 Aug 02 10:30:08.373390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 797/1597] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:08.422705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:08.432225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7409b8ea-8e5e-400f-9127-2b41aaa56cd2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.163538 Aug 02 10:30:08.432808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 801/1598] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:08.789297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:08.791582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:08.797992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.798441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.799267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.799708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.831613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be583e14-ecf6-44eb-b6f3-3d89f5e1c99c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Aug 02 10:30:08.832199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 798/1599] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:08 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:08.966238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:08.968468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:08.976278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.976633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:08.977361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:08.977795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.008884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b000edd5-01d2-4523-bf46-c46361d6b4ee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 Aug 02 10:30:09.009453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 802/1600] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:09.391570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:09.393647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:09.400353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.400729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.401504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.401938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.433889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-374d557c-9555-49e7-9ff4-369902e46da5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046459 Aug 02 10:30:09.434463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 799/1601] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:09.454490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:09.455408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:09.462245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.462861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.464615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.466553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.612137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:09.621447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bedeacfb-e096-4ee4-9d4d-d540ece4df4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.170848 Aug 02 10:30:09.622024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 803/1602] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:09.844761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:09.846908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:09.853341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.856818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.856818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:09.856818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:09.858227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:09.888233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-75f28b71-b88e-4286-a5a8-81350d045f68 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047480 Aug 02 10:30:09.888818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 800/1603] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:10.022161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:10.024268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:10.031456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.031904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.032678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.033115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.036943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:10.063437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8cace6f3-1796-4e89-8569-d146331267ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Aug 02 10:30:10.063998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 804/1604] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:10.446827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:10.449490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:10.456293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.456744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.457571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.458015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.489218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-686a07f7-92e3-448e-9008-08826c8bc9b1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046899 Aug 02 10:30:10.489793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 801/1605] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:10.645207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:10.645829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:10.652896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.653337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.654239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.654679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.813669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:10.821824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2309665a-b4cb-4d20-8913-40414802dabb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.181000 Aug 02 10:30:10.822395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 805/1606] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:10.900602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:10.902936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:10.909137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.909871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.910350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:10.910786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:10.942094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-710b7bdc-8713-4b76-b609-800e92e31c8a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Aug 02 10:30:10.942667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 802/1607] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:11.077270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:11.079713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:11.088089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.089264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.090182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.090672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.124284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b469d200-d414-47e0-886d-adb3ff7b04ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051767 Aug 02 10:30:11.124886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 806/1608] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:11.501363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:11.503544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:11.506149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:11.511584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.512039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.512814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.513245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.545062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b5253c9d-e3bb-4b0a-8535-19e4db57a4f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047845 Aug 02 10:30:11.545611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 803/1609] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:11.843995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:11.844529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:11.850937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.851439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.852220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.852653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.955357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:11.957730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:11.965212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.965807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.966814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:11.967419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:11.998422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:12.002651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6066839e-3725-47c0-85e8-416fc1fcc07e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052225 Aug 02 10:30:12.003266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 804/1610] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:12.006475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9cd0ffa8-176b-470c-8ca3-6dd683256a3c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.166640 Aug 02 10:30:12.007041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 807/1611] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:12.137224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:12.139301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:12.145570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:12.146010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:12.146785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:12.147279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:12.178616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da5c66cf-1ef8-49dd-b355-34e69285ac72 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Aug 02 10:30:12.179202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 805/1612] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:12.558160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:12.560356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:12.566915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:12.567396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:12.568165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:12.568602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:12.599286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30f6bc45-ae38-43e6-8574-55d8cb9460e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045683 Aug 02 10:30:12.599862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 808/1613] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:13.016135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:13.018517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:13.025307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.025760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.026594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.027033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.038023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:13.038809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:13.045048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.045487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.047406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.047864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.066586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63e8bdbd-35ad-4188-8c0c-ec853e8f551f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054464 Aug 02 10:30:13.067159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 806/1614] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:13 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:13.190908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:13.191310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:13.193135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:13.199271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2b9c8cd-88b6-41bf-b2c5-0716f5063561 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169905 Aug 02 10:30:13.199800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.199800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.200236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 809/1615] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:13.200576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.201054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.233222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1cefa93f-52ce-4fcb-94dc-30052e0737be tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Aug 02 10:30:13.233916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 807/1616] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:13.612290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:13.614663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:13.622970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.623454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.624255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:13.625408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:13.660723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-21533b28-b19b-4325-ae98-08c2c2630238 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052712 Aug 02 10:30:13.661309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 810/1617] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:14.079608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:14.081948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:14.089009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.089454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.090223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.090649 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.124869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b4d3836-edde-4593-b0ce-aaa862c266af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049570 Aug 02 10:30:14.125748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 808/1618] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:14.226548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:14.227378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:14.234495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.234938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.235824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.236895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.254355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:14.257526 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:14.264269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.264851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.265772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.266282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.304359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2f3275b1-fba7-4a8e-9fb7-49aac55dd3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060880 Aug 02 10:30:14.304989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 809/1619] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:14.395081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:14.404868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3863a2ec-a17f-4bc0-8db0-9ae15414d855 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.183124 Aug 02 10:30:14.405533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 811/1620] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:14.676572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:14.678813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:14.685420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.685869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.686677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:14.687107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:14.727811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-df4abe03-ac77-442d-a71d-c56a40f4d9d9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057708 Aug 02 10:30:14.728399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 810/1621] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:15.137767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:15.141070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:15.147442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.147894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.148673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.149108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.180418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-265dd079-e464-4de4-92d1-bd1d4269c8c5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046589 Aug 02 10:30:15.180996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 812/1622] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:15.317266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:15.319734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:15.329168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.329973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.331409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.332154 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.373354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d8dfc5bb-4ed1-42ce-99b0-c1d26196400d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060169 Aug 02 10:30:15.373958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 811/1623] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:15.427629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:15.428161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:15.435626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.436094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.436858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.437312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.598403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:15.607048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-485ec796-e14d-4b2a-ae2d-c4491e3789d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.183291 Aug 02 10:30:15.607726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 813/1624] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:15.744215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:15.748039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:15.753320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.753761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.754859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:15.755229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:15.793521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eebe119a-e3c7-4eea-a16c-c7ea545e8aae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054969 Aug 02 10:30:15.794108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 812/1625] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:16.193404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:16.196765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:16.204608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.205263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.206118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.206550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.243862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d19d9816-bdac-4eb9-b180-329d337f2f43 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054311 Aug 02 10:30:16.244896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 814/1626] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:16.388214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:16.390422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:16.397519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.397963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.398777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.399240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.431696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9b6dd95-925f-4bcd-badd-41d3b6942973 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047420 Aug 02 10:30:16.432888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 813/1627] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:16.630431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:16.631054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:16.637553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.637996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.638758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.639210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.778675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:16.791574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-08b74ac6-728c-4953-9624-6d970cf12ef7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.160714 Aug 02 10:30:16.791574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 815/1628] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:16.806725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:16.809473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:16.815808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.816254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.817026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:16.817459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:16.847935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-df9be981-02cf-4dc4-8b24-e893eda5c7c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045644 Aug 02 10:30:16.848507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 814/1629] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:17.258400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:17.261154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:17.267287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.267733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.268503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.268933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.302882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2054906-bbb8-4d1f-a577-11be0143980d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048623 Aug 02 10:30:17.303482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 816/1630] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:17.444703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:17.446854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:17.454332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.454778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.455617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.456058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.488246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-95fc09ad-a566-46b2-92db-91a78452a08a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Aug 02 10:30:17.488819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 815/1631] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:17.809199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:17.809973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:17.816684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.817132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.817914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.818333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.860587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:17.862787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:17.872773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.873208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.874019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:17.874459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:17.899894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:17.906133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f3e30be-187c-4c04-b834-dcc9269c615c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049592 Aug 02 10:30:17.906719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 816/1632] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:17.957484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:17.966346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-17a95584-f9ef-41e6-aadd-5a419e5a20dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161555 Aug 02 10:30:17.966925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 817/1633] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:17 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:18.330808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:18.333052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:18.340004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.340447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.341216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.341730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.377901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f854b150-ecbf-4b58-96f7-24d030988aa0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051427 Aug 02 10:30:18.378490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 817/1634] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:18.501452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:18.503632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:18.510222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.510666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.511477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.511919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.543841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cebe8882-440f-44d9-b249-ec6ad7320741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046427 Aug 02 10:30:18.544423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 818/1635] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:18.927938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:18.930051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:18.936835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.937272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.938061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.938504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.969714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ef0219ac-4444-48cb-b491-a498710385c2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045877 Aug 02 10:30:18.970292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 818/1636] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:18.988491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:18.989125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:18.996300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.996753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:18.997538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:18.997976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.142005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:19.149993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-105a8392-7f89-421e-8af4-46270482a799 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.165347 Aug 02 10:30:19.150579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 819/1637] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:19.389999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:19.392174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:19.398260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.398704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.399515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.399948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.433121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6934e08d-c74d-4a3e-bbc2-a46dbba0b6e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046636 Aug 02 10:30:19.433714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 819/1638] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:19.556739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:19.560627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:19.568476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.568918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.569686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.570113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.595923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:19.600572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69023141-32b0-41c6-b835-5a38b8cde242 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047860 Aug 02 10:30:19.601155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 820/1639] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:19.982354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:19.984561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:19.991079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.991551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:19.992314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:19.992742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.023223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-963e0dd1-f13b-41ea-8f92-f11cbd162438 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044908 Aug 02 10:30:20.023788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 820/1640] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:20.172562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:20.173137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:20.180348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.180795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.181565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.182000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.320425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:20.328948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-398ff0b3-a67a-4825-8ec7-ee5e532f2f2e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.160292 Aug 02 10:30:20.329526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 821/1641] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:20.445751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:20.447944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:20.454617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.455059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.455852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.456283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.484954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-55d5854f-f44e-473c-bdfb-d000ca90591d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Aug 02 10:30:20.485510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 821/1642] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:20 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:20.613920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:20.616074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:20.622756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.623207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.623976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:20.624434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:20.652624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e1f1d99-5f70-44de-998d-fde531e99582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Aug 02 10:30:20.653204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 822/1643] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:21.036705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:21.038843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:21.045598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.046036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.046798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.047248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.078852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a6f1c92-cca5-47ea-9709-1f6fd53d7953 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046129 Aug 02 10:30:21.079456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 822/1644] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:21.350759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:21.351307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:21.358593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.359033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.359830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.360257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.499053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:21.501418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:21.502052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:21.509409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7b5e0dca-82d3-4d15-9b2e-1d3103f1d892 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162548 Aug 02 10:30:21.509986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 823/1645] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:21.516051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.516501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.517290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.517728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.550583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cfcf88c9-f095-4442-b1c9-d8e9b370f3db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056881 Aug 02 10:30:21.551214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 823/1646] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:21.666685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:21.668856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:21.675627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.676083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.676898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:21.677434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:21.707961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aad3b029-1155-46dc-a3cb-3b058ef68afc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Aug 02 10:30:21.708531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 824/1647] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:22.095626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:22.099211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:22.110642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.111434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.112789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.113537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.170401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-faa9a9e8-5cb3-4f94-9ad9-1d67327ce8fa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081732 Aug 02 10:30:22.171413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 824/1648] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:22.531877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:22.532522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:22.539420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.539869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.540649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.541084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.564339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:22.566819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:22.574075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.574519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.575330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.575759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.621242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0853c200-b1fd-4f0a-a4f4-872fe02a70e2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061441 Aug 02 10:30:22.622350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 825/1649] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:22.692265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:22.701071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97f54ac2-571c-4211-93a4-37cc844a02b0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.173009 Aug 02 10:30:22.701651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 825/1650] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:22 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:22.724663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:22.728390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:22.738927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.739685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.740967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:22.741679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:22.796379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7218a5db-7b06-4ebe-b73b-4984b35cc851 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078383 Aug 02 10:30:22.797228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 826/1651] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:23.183395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:23.185644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:23.192384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.192962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.193927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.194450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.226517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4bb3699a-5c73-4178-9f9f-66fbd76ccf0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047807 Aug 02 10:30:23.227094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 826/1652] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:23.637995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:23.640293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:23.646829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.647293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.648062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.648492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.680284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3f91dfd5-b00e-4c37-9503-e39479a7639a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Aug 02 10:30:23.680875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 827/1653] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:23.724131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:23.725173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:23.732776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.733354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.734276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.734816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.810000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:23.812139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:23.822344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.824448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.825051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:23.825843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:23.858795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4bc6615e-e1b5-4e6b-979e-9ecf5284700d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052972 Aug 02 10:30:23.859691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 828/1654] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:23.913237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:23.921574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8a421038-0572-446f-801f-81503d04c5c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.202829 Aug 02 10:30:23.922245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 827/1655] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:24.242584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:24.244806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:24.251404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.251848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.252631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.253068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.286099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9bb1824a-2f53-4d3d-85b8-8058f0ebcd43 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047768 Aug 02 10:30:24.286680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 829/1656] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:24.693155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:24.695391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:24.701876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.702327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.703116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.703653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.737259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-73002b94-bc08-4a7e-93d7-5175a316c03c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048275 Aug 02 10:30:24.738028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 828/1657] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:24.873123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:24.875961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:24.888715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.889496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.890846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.891781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.924199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dacd9903-04b9-4549-9f54-5c495ce5d237 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056852 Aug 02 10:30:24.924886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 830/1658] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:24.947401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:24.948979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:24.958415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.959101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:24.960319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:24.960976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.145123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:25.154309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9cb8c2ea-2737-4cc3-9dda-3a0e4499ec30 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.213506 Aug 02 10:30:25.154982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 829/1659] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:25.299697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:25.303711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:25.311601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.312111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.313020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.313512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.347794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d7f90f9b-9b5b-439f-8d2e-18d20dfd4aa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053324 Aug 02 10:30:25.348646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 831/1660] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:25.750794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:25.753000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:25.760154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.761989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.762908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.763564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.797584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bb95557d-dcad-494d-a08c-2bae5b3cfb12 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050672 Aug 02 10:30:25.798293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 830/1661] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:25.937533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:25.940950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:25.950086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.950533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.951344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:25.951775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:25.983846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7580a862-da2d-46d5-837b-d1b8b46d87c2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050279 Aug 02 10:30:25.984583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 832/1662] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:26.176990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:26.177574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:26.179582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:26.185615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.186317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.187148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.187665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.356110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:26.361654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:26.363878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:26.369576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-deb3e2a4-8eab-43f4-9c6d-9f4ccc893308 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.196493 Aug 02 10:30:26.370558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.370741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 831/1663] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:26.370991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.371897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.372341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.388140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:26.405802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-479aa2bf-2bc2-4bed-9b76-bcc13d8b2b53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048142 Aug 02 10:30:26.406390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 833/1664] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:26.811445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:26.814385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:26.821423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.821878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.822663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:26.823623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:26.856163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aeaf54f6-7a58-47e0-8bfc-c3445f852572 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050054 Aug 02 10:30:26.856764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 832/1665] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:26.997529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:26.999894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:27.007438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.007892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.008670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.009106 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.041320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-714bbb45-62f4-4f83-be87-a2cf6e63afea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048431 Aug 02 10:30:27.041889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 834/1666] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:27.394995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:27.395553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:27.402038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.402489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.403312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.403756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.423010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:27.426135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:27.433237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.433857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.434634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.435072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.472276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc02b381-da2d-4fd2-95dc-e5df62c3bfce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053667 Aug 02 10:30:27.473065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 835/1667] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:27.562367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:27.571714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0f358ddf-6cda-4d09-848c-c11e0901a760 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.180664 Aug 02 10:30:27.572292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 833/1668] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:27.869379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:27.872233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:27.878516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.878962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.879770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:27.880467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:27.914335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fba54df9-01cd-49f8-a427-6ca013842bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048983 Aug 02 10:30:27.914903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 836/1669] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:27 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:28.054310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:28.056532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:28.063544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.063992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.064933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.065374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.105553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eedfe0e2-63ed-416e-91b7-fa7fe6aa7297 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055342 Aug 02 10:30:28.106149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 834/1670] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:28.485552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:28.487747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:28.495678 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.496131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.496921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.497360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.530478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9aeaf9eb-b7c7-465b-8e55-02e464051f94 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048913 Aug 02 10:30:28.531381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 837/1671] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:28.593748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:28.594430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:28.600788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.601237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.602058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.602502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.742903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:28.751458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b2195df5-9022-40dc-9a20-a2b2e4927451 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161467 Aug 02 10:30:28.752045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 835/1672] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:28 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:28.930250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:28.932630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:28.938619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.939084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.939885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.940316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.972054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4205b52a-6e9e-4a62-8f7a-193545b35535 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Aug 02 10:30:28.972626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 838/1673] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:29.117726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:29.120573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:29.127541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.128062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.128847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.129276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.161019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99cb160a-199f-4410-8b17-48297963dd2b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047213 Aug 02 10:30:29.161583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 836/1674] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:29.549405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:29.551616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:29.558450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.558902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.559724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.560158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.592533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3945cd1-5e9e-4196-b16e-b684e5d0ef4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047143 Aug 02 10:30:29.593110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 839/1675] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:29.774056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:29.774649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:29.781237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.781677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.782448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.782879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.802951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:29.925977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:29.934663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-20849e41-321d-4fb1-8db9-abf9837d9b55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164771 Aug 02 10:30:29.935285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 837/1676] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:29.985643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:29.987902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:29.994312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.994748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.996075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.996486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.027614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b2d7d68-7f56-4698-8c29-3700d5267c37 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Aug 02 10:30:30.028184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 840/1677] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:30.173830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:30.175988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:30.183177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.183878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.184789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.185232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.218164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0dc9cb64-8036-4e11-9629-78dfd8695cda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048505 Aug 02 10:30:30.218727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 838/1678] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:30.605005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:30.607100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:30.614975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.615504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.616280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.616714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.649448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f795e47-64db-4328-a3ea-2201aae4eb72 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049007 Aug 02 10:30:30.650236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 841/1679] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:30.957971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:30.958424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:30.965648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.966088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.966859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.967317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.041189 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:31.044216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:31.051003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.051615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.052735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.053257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.091372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-28c2f704-7807-4958-8985-cfef8472c743 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055046 Aug 02 10:30:31.092149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 842/1680] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:31.121066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:31.129797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2e817f40-744c-4de0-928a-398fbaa46189 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.176276 Aug 02 10:30:31.131541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 839/1681] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:31.232530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:31.234757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:31.244891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.245769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.247088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.247858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.284634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-01aa7743-fed8-4de3-964e-b74e8d6f18f6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056129 Aug 02 10:30:31.285312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 843/1682] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:31.662604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:31.665762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:31.674108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.674531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.675405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.675849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.709771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-259eef8e-e865-4507-b0a3-01796f2b3d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051311 Aug 02 10:30:31.710410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 840/1683] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:32.104938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:32.107269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:32.113723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.114266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.115402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.115402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.151979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-49dbd4f5-b3e1-498d-89ab-a77077ca4a7a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051481 Aug 02 10:30:32.152564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 844/1684] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:32.153905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:32.154691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:32.161743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.162273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.163124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.163685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.298387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:32.300882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:32.310062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.310512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.310841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:32.311313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.311750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.320392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e9aaa4eb-f6e2-4cd3-907b-5eff6e2c12f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.171090 Aug 02 10:30:32.321140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 841/1685] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:32.348472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b38d4918-c42b-452b-8802-3c17ddeaf3f9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055459 Aug 02 10:30:32.349056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 845/1686] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:32.724649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:32.726889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:32.735096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.735096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.736572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.736572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.778585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c470f309-c4dd-4628-b652-84505e0510b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058076 Aug 02 10:30:32.779162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 842/1687] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:33.164658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:33.166949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:33.174499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.174932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.175780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.176205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.209295 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a009b5b8-dc64-4001-8c35-1bf884844c6f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048640 Aug 02 10:30:33.209900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 846/1688] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:33.345392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:33.345936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:33.352405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.352857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.355538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.355538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.365645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:33.368343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:33.377096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.377618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.378482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.378925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.421152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7777b2fc-b21e-4e44-878a-22a955ec7f62 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062899 Aug 02 10:30:33.421959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 847/1689] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:33.522904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:33.534886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-758cb198-ebbf-4a2a-917c-2e983b5218ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.193576 Aug 02 10:30:33.539251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 843/1690] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:33.790329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:33.792627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:33.798899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.799382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.800164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.800653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.832820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4031aa47-46bc-4145-a377-e07546d219ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046560 Aug 02 10:30:33.833395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 848/1691] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:34.222781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:34.227112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:34.234837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.245761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.245761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.245761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.275933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5686f50c-c9e0-4a02-9a61-e13934f63d65 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057643 Aug 02 10:30:34.277062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 844/1692] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:34.434789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:34.436988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:34.444506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.445055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.445906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.446426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.481656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d93ca1d-2454-4975-916b-577b3fbeae02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050976 Aug 02 10:30:34.482285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 849/1693] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:34.558545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:34.559287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:34.566243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.566682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.567545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.568027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.760210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:34.780528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d3fd848-c493-457c-ace8-1d8a91f9059e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.226243 Aug 02 10:30:34.781274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 845/1694] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:34.846759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:34.849175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:34.857337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.858221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.859462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:34.860067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:34.862927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:34.903793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-01eb2e5b-5204-4769-9e89-868d0628d453 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060668 Aug 02 10:30:34.904641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 850/1695] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:35.290131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:35.292543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:35.300934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.301379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.302170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.302643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.342867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-49cbce27-3655-45f5-8263-e6a9a1ac5ec2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056969 Aug 02 10:30:35.343480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 846/1696] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:35.496525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:35.499128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:35.512145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.513199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.514234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.514845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.569233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c5e1fb6b-d9b9-4ef1-af5b-69d111965057 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076632 Aug 02 10:30:35.570437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 851/1697] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:35.816581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:35.818126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:35.827282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.827716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.828499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.829075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.919053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:35.922428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:35.933172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.933671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.934978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:35.935488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:35.988806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe6d56e7-be47-4a07-8eda-9443c34c7ef7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074908 Aug 02 10:30:35.991016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 852/1698] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:36.021928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:36.031699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69d41d46-a549-43b3-acfd-f95b500f358c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.222261 Aug 02 10:30:36.032291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 847/1699] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:36.356052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:36.358361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:36.360319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:36.365354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:36.366139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:36.366574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:36.367013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:36.400022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1162c633-bcba-4aaa-ab21-602e4cc73780 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048619 Aug 02 10:30:36.400936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 853/1700] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:36.586435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:36.588963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:36.596131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:36.596673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:36.597459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:36.598055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:36.638957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8367784e-03c2-4667-928d-169bad5fdae2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056982 Aug 02 10:30:36.639532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 848/1701] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:37.004964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:37.008024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:37.018776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.019373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.020434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.021177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.057046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:37.058220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:37.060178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ed15b2d-da0c-4f13-a227-c952344d7806 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059494 Aug 02 10:30:37.061362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 854/1702] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:37.065650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.066101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.066870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.067449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.228447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:37.238202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5b2ddd57-12a9-4894-a387-d395d7d7955f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.185135 Aug 02 10:30:37.238784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 849/1703] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:37.413910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:37.416161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:37.423159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.423632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.424422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.424856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.466425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69c7f56b-489d-43a0-a607-a7a70c0f318b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056585 Aug 02 10:30:37.467010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 855/1704] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:37.654884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:37.658198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:37.669180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.669892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.671175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:37.671938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:37.712187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b1b3410a-9291-4382-b7c8-0079faf0b7f4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064833 Aug 02 10:30:37.715211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 850/1705] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:38.074027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:38.076556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:38.086094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.086893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.087732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.088202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.126434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-507a6546-18d2-4ed6-92f9-612afc21ff38 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057264 Aug 02 10:30:38.127402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 856/1706] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:38.272429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:38.273233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:38.284869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.285519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.286895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.287575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.482766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:38.485084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:38.492443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.492970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.493787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.494489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.501416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:38.510400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b201829-6eaf-4970-97c3-83b2a6ff7a1d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.246386 Aug 02 10:30:38.511759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 851/1707] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:38.532423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63975361-e95a-4e0b-b358-344e14e3bf34 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054792 Aug 02 10:30:38.541512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 857/1708] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:38.733065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:38.736645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:38.748616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.749615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.750851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:38.751795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:38.794348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-966554bb-edcd-441b-94c3-fd830f5ea1bd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069553 Aug 02 10:30:38.795017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 852/1709] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:39.144502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:39.147459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:39.156406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.157064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.158364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.159086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.202897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fef1853e-e191-4b7c-92d2-4ca5db3619be tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065464 Aug 02 10:30:39.203527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 858/1710] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:39.545835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:39.546825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:39.557138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.557630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:39.558555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.559951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.560717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.561805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:39.571469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.572188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.573498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.574174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.624147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e4d13bc-1645-425a-8532-5f822cd5ecba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073819 Aug 02 10:30:39.624741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 859/1711] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:39 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:39.728166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:39.737445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-66271608-b066-428e-a982-ab8567ac9dc0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.196459 Aug 02 10:30:39.738252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 853/1712] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:39 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:39.806871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:39.809687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:39.816741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.817191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.817980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:39.818411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:39.854125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b8aaa7cd-5a79-4599-8658-e56922abbe6e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051382 Aug 02 10:30:39.854777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 860/1713] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:40.219553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:40.221661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:40.228582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.229028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.229840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.230272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.234368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:40.270186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-658f2c0f-88f3-4970-a1c3-ad86fed6a8df tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054620 Aug 02 10:30:40.271145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 854/1714] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:40.643529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:40.647039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:40.657436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.658124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.659311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.660049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.705622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-adf6eaf6-3013-40bd-b673-0f5c71737bd1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069132 Aug 02 10:30:40.706333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 861/1715] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:40.761217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:40.761876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:40.768871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.769325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.770114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.770548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.866101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:40.868316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:40.875531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.875980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.876764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:40.877198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:40.910885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ff9ac81e-c81c-4917-9c46-12bce16d2bd5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048669 Aug 02 10:30:40.911524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 862/1716] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:40.921271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:40.930127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-100809c1-bbea-4fc7-a031-88ad0d05fa6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.173430 Aug 02 10:30:40.930709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 855/1717] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:41.284170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:41.286423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:41.293597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.294047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.294832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.295306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.328118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b408ecb-59f5-4dd0-8f6f-e147fd6cb88e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048120 Aug 02 10:30:41.328708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 863/1718] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:41.719488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:41.721570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:41.728861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.729803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.730595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.731038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.763705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d566531e-b1bf-4541-99e1-0102addf9f16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048326 Aug 02 10:30:41.764450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 856/1719] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:41.924260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:41.926553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:41.934685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.935269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.936117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.936663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.960303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:41.961070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:41.969145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.969822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.970669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:41.971220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:41.974554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f221171d-e4c1-4dc5-bab5-6832fe7ae122 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054851 Aug 02 10:30:41.975278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 864/1720] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:42.121665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:42.130078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55b4db2a-1ca8-42f9-a70e-18ce3fd19f79 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.174187 Aug 02 10:30:42.131010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 857/1721] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:41 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:42.344169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:42.347546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:42.358018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:42.358755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:42.360036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:42.360766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:42.413474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-48804fbf-d64b-4c07-8b59-931b680aebb8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075989 Aug 02 10:30:42.414493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 865/1722] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:42.777546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:42.779766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:42.786947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:42.787428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:42.788266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:42.788700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:42.821121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e8bb7cc7-5bb9-47a1-92e1-a02a0766a77e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Aug 02 10:30:42.821688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 858/1723] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:42.990478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:42.993012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:43.000600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.001050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.001836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.002276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.029305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:43.035482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7f770322-74a1-4bc9-a48b-a6dfbc5edc0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049495 Aug 02 10:30:43.042721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 866/1724] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:43.153846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:43.154473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:43.161373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.161885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.162745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.163270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.348604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:43.357538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bebb40d6-4e65-4725-b4a1-c271a6a53a9f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.207658 Aug 02 10:30:43.358196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 859/1725] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:43.426992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:43.429348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:43.436601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.437047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.437822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.438253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.471309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad427ded-85e0-4584-9b96-d078fe9b720d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048862 Aug 02 10:30:43.471886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 867/1726] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:43.835593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:43.837989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:43.845419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.845864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.846677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:43.847108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:43.886290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a9a6e25-982d-4002-a5b5-545f0dd8557b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054184 Aug 02 10:30:43.886984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 860/1727] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:44.055635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:44.059284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:44.070860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.071837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.074011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.074640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.115348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25b24529-3d39-462e-9f84-865ab9722083 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064758 Aug 02 10:30:44.116029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 868/1728] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:44.380427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:44.381235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:44.387664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.388110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.388877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.389312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.486563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:44.489353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:44.496721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.499395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.499395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.499395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.538730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-00fefa52-1c0e-402d-8915-64b8d88d8633 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057362 Aug 02 10:30:44.539350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 869/1729] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:44.566051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:44.574478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69b6b717-6e52-4685-ba73-0a6bb6819f93 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.198203 Aug 02 10:30:44.575111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 861/1730] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:44.900010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:44.902821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:44.909128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.909614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.910502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:44.911002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:44.944654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-253a643e-3dbf-4dad-8a79-2c24a5222048 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048683 Aug 02 10:30:44.945323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 870/1731] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:45.127986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:45.130193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:45.137236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.137731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.138638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.139119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.173181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6e90b9f1-0fea-4cac-b109-e6f168bbcbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049231 Aug 02 10:30:45.173743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 862/1732] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:45.551316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:45.553609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:45.561165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.561611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.562388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.562824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.596253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:45.596971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:45.603911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.604878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.605765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.606200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.606471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0ddd17e8-67e6-461f-8380-8d2423153ed1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058890 Aug 02 10:30:45.607519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 871/1733] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:45.753647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:45.762453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e7fe1d9d-9534-446c-98a7-22a486f20baa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.170088 Aug 02 10:30:45.763032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 863/1734] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:45.958259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:45.960415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:45.967507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.967964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:45.968741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:45.969175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.002365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-75c9594e-6d4d-4c34-b694-cfd872f1040c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048328 Aug 02 10:30:46.002938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 872/1735] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:45 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:46.186722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:46.189049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:46.195686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.196133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.196915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.197348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.230140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-acfbb968-cc0d-4909-b7e3-dc1005458875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Aug 02 10:30:46.230755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 864/1736] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:46.630024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:46.632628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:46.640223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.640676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.641602 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.642042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.675297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-40c5d1d7-8651-4803-b7ae-7a9223dcbcef tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056202 Aug 02 10:30:46.675922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 873/1737] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:46.798632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:46.799423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:46.807431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.808637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.809525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:46.810002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:46.961653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:46.970477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8eaafea-c35a-437f-9856-e6b9cf279767 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.175845 Aug 02 10:30:46.971106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 865/1738] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:46 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:47.017409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:47.019721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:47.026535 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.026975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.027808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.028253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.060561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ba61f75a-3486-4925-99f0-64698e0a281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Aug 02 10:30:47.061118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 874/1739] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:47.242375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:47.244579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:47.251395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.251839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.252615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.253045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.294595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-37c69f8f-f4b6-4c1a-9fda-c780f1ac7e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055878 Aug 02 10:30:47.295613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 866/1740] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:47.688812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:47.691014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:47.698738 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.699431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.700211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:47.700642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:47.733999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e30ae74c-f7a4-4f5f-a3ea-6939f28ddc98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049116 Aug 02 10:30:47.734577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 875/1741] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:47.992761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:47.993336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:48.001090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.001539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.002356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.002801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.074334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:48.076828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:48.084026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.084549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.085540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.086061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.119590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d449e869-2934-455c-a2aa-25de7633bb49 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Aug 02 10:30:48.120963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 876/1742] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:48.162351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:48.170562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d94720c-2443-4f18-b6ca-1efe9e483b18 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.181829 Aug 02 10:30:48.171153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 867/1743] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:48.307880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:48.310045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:48.316700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.317140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.317923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.318347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.350650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb4d1a9b-60a7-4304-bef4-b38e28a45e47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Aug 02 10:30:48.351256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 877/1744] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:48.747589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:48.749795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:48.756584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.757061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.757841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:48.758276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:48.790749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-00796a29-1568-4efe-a4b1-bc35c400bea6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047780 Aug 02 10:30:48.791349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 868/1745] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:49.133481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:49.136133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:49.143028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.143502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.144282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.144709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.176984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edafe00d-3628-40b6-8a78-8cb9fd230fa6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Aug 02 10:30:49.177557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 878/1746] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:49.205055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:49.205666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:49.212629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.213068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.213838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.214280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.353047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:49.364779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1527c8c-7e05-49be-8485-48438271b97d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.163378 Aug 02 10:30:49.365693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 869/1747] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:49.366700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:49.369116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:49.377234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.377814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.378656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.379131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.413499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe15f48d-542b-4afe-a6ab-270a84cd8fe5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053224 Aug 02 10:30:49.414438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 879/1748] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:49.803740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:49.805903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:49.812456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.813081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.813857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:49.814285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:49.841745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:49.846317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6a9694f9-be9a-4cf5-a505-d718b75a0e65 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046763 Aug 02 10:30:49.846888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 870/1749] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:50.191159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:50.193459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:50.200670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.201116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.201888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.202320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.235494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c9e94f28-8a60-4797-a4ab-b6a08bc61a1e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048342 Aug 02 10:30:50.236094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 880/1750] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:50.390835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:50.391545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:50.398855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.399337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.400111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.400529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.430839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:50.434586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:50.445499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.446181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.447593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.448414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.504850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ba37d898-3535-4393-a8ff-1ee3a5781b7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081063 Aug 02 10:30:50.505931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 881/1751] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:50.543519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:50.551495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-22196fe9-fcf5-47bd-ab7b-1ce36bcb0f4e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164570 Aug 02 10:30:50.552107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 871/1752] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:50.859450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:50.861767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:50.868497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.868941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.869734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:50.870234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:50.906929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9ef19f73-80d7-4122-8d50-7805b2360660 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051640 Aug 02 10:30:50.907567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 882/1753] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:51.248185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:51.250699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:51.257636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.258088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.258902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.259385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.290026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eda3811a-19cf-42c7-9958-f3c244cb127f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Aug 02 10:30:51.290603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 872/1754] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:51 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:51.519471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:51.521706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:51.529075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.529516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.530325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.530761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.546532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:51.567923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e9e37603-bb6f-49bc-99a2-657d13a379a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052546 Aug 02 10:30:51.568517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 883/1755] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:51.576504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:51.577592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:51.586756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.587256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.588033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.588465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.733815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:51.741850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-095bfbb3-db6c-4110-9c6f-ad1361667249 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.171928 Aug 02 10:30:51.742450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 873/1756] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:51.922825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:51.924963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:51.931799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.932242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.934073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:51.934558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:51.969919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d779d1e-3f96-460f-8ec0-fb33382e8f1c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051775 Aug 02 10:30:51.970504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 884/1757] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:52.302737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:52.304978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:52.311944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.312386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.313187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.313617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.344586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-27a4a509-b3d1-43cb-a903-9bcd53340482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045834 Aug 02 10:30:52.345334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 874/1758] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:52.580463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:52.582521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:52.589916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.590353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.591127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.591587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.624900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5034b72c-3f33-4955-9dd4-745d5f1e475a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048436 Aug 02 10:30:52.625555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 885/1759] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:52.765081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:52.765705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:52.772860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.773303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.774071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:52.774503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:52.919116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:52.927224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-948a2105-3c79-49df-93f0-e634cb728e71 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.166410 Aug 02 10:30:52.927796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 875/1760] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:52.987132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:52.991040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:53.002177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.002936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.004359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.005109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.064865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1eb71786-4837-4d47-adbf-93145f3f6c26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085643 Aug 02 10:30:53.065875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 886/1761] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:53.358194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:53.360786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:53.370139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.370971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.372320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.373066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.429666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-61e32b21-7fb8-407e-8a53-5abbe587281a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075927 Aug 02 10:30:53.430674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 876/1762] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:53.639130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:53.641243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:53.647685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.648135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.648925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.649364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.681719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1545a4d-3dc4-4e1e-87e7-6028366de0fa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Aug 02 10:30:53.682294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 887/1763] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:53.951021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:53.951671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:53.958875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.959362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:53.960152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:53.960590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.078961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:54.081179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:54.087658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.088102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.089359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.089852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.113597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:54.125326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-42197941-8123-4554-a766-0c605e349630 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050416 Aug 02 10:30:54.126123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 888/1764] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:30:54.126663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f3744cf2-c890-4060-9286-ee1b82b60a89 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.180016 Aug 02 10:30:54.127702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 877/1765] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:54.442596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:54.445229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:54.452148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.452655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.453477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.454032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.485249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b2f1e589-2d89-4f19-b377-32aff8d54189 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046861 Aug 02 10:30:54.485827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 889/1766] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:54.694373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:54.696726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:54.702994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.703484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.704284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:54.704727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:54.735217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbfc8942-50aa-4cfb-884d-d19c389ed2c1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Aug 02 10:30:54.735801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 878/1767] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:55.139781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:55.142328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:55.149462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:55.149772 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.150211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.150421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:55.150996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.151560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.159549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.160082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.161036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.161562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.185357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bdad661a-6e17-4485-b049-f65e0f822f95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049811 Aug 02 10:30:55.185963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 890/1768] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:55.341288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:55.356706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2081eee5-6694-49b1-8e95-6d113dd33879 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.211126 Aug 02 10:30:55.357682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 879/1769] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:55.498748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:55.501057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:55.508114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.508565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.509401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.509869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.544203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a6879d6-4440-42d8-870c-ad46025f9811 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050020 Aug 02 10:30:55.544788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 891/1770] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:55.748674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:55.750888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:55.758155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.758607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.759423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:55.759865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:55.801710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-41da0ad8-057d-4b31-8f1b-7fa0d7840f45 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057356 Aug 02 10:30:55.803156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 880/1771] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:56.199632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:56.201840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:56.209205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.209655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.210456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.210895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.245600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-40c44131-0b55-4319-9f22-decba67ff1b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050419 Aug 02 10:30:56.246202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 892/1772] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:56.380407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:56.381089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:56.383925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:56.390649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.400363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.400363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.400363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.544602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:56.552480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c991bf8a-6e55-4615-a701-bbd9e5edd215 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.176331 Aug 02 10:30:56.553272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 881/1773] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:56.560456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:56.564267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:56.575908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.576693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.578068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.578851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.618899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-079dd038-a5df-4980-91fd-ae64fa86185c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065941 Aug 02 10:30:56.619773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 893/1774] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:56.818780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:56.820998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:56.827890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.828334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.829142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:56.829582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:56.861243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-22d3378a-8f79-4165-89f4-16baaa372cfd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Aug 02 10:30:56.861818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 882/1775] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:57.258560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:57.260766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:57.267901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.268385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.269206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.269676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.301950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2368b66e-198c-46ce-b837-b90e3fbca757 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047652 Aug 02 10:30:57.302516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 894/1776] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:57.587690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:57.689411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:57.689411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.689411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.689411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.689857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.689975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:57.689975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:57.689975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.689975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.690349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.690349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.690349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb30ff5f-672a-4faa-8848-23ab5163a5c3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052472 Aug 02 10:30:57.690349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 895/1777] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:57 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:57.746184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:57.753881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-98144191-6a64-4a70-ad0d-025a265a46da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.170242 Aug 02 10:30:57.754447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 883/1778] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:57.877611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:57.879702 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:57.886831 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.887314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.888135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:57.888565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:57.918974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-afd84d45-df41-455e-8b43-ed8f1e852f88 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Aug 02 10:30:57.919592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 896/1779] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:58.316864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:58.319706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:58.329188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.329744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.330931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.331746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.366933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-43a3ce45-9340-4fdc-957a-dcfeaf49813c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056008 Aug 02 10:30:58.367618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 884/1780] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:58.693578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:58.695679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:58.703101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.703578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.704347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.704774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.734031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fd7615e8-af9e-424d-9bbe-3e3d035cea77 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Aug 02 10:30:58.734596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 897/1781] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:58.778074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:58.778802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:58.786757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.787557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.788489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.788975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.932635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:58.936423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:58.937964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:58.944904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.945455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.946361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:58.946472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b57cd57-e701-4984-b640-45d012487754 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.173691 Aug 02 10:30:58.946919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:58.947490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 885/1782] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:58.992479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a1651e7b-384f-414b-87d9-669a4b65f437 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064677 Aug 02 10:30:58.993083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 898/1783] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:30:59.380536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:59.382942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:59.389176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.389625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.390397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.390830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.421166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9fcd1bef-54f9-4aed-8e23-3c9fea733576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045304 Aug 02 10:30:59.421750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 886/1784] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:30:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:30:59.747656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:59.749850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:59.756510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.757201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.757956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.758383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.789234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bf52c0db-e435-458b-9dd4-43a85d812455 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Aug 02 10:30:59.789805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 899/1785] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:30:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:59.969000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:59.969603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:59.976258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.976699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.977469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:59.977900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:59.997119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:00.010452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:00.013762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:00.020775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.021306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.022448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.022761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.028330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:00.060369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6deabac8-b815-4aec-a0f4-a5078bd9f422 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054957 Aug 02 10:31:00.062178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 900/1786] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:00.123508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:00.134409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4ee3f22c-43ce-475f-aa07-c470f3a2cb4c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169847 Aug 02 10:31:00.135663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 887/1787] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:59 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:00.435754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:00.438311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:00.447361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.448060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.449074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.449598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.487564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e97a013-f130-483e-ad94-74718dedd11d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057384 Aug 02 10:31:00.488585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 901/1788] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:00.802670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:00.805137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:00.812062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.812607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.813507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:00.814024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:00.847683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30e07e7d-7c0b-4153-a507-c820ce49c443 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049694 Aug 02 10:31:00.848329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 888/1789] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:01.078607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:01.080614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:01.088321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.088815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.089690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.090255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.126538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da0496e0-ea0c-4cd7-ae5e-f6f4b559ce6f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054048 Aug 02 10:31:01.127237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 902/1790] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:01.158565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:01.159338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:01.167962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.168449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.169343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.169819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.313319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:01.321227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc7e0c3a-aaa7-4fa8-9e5f-25b623a9e2c1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.167087 Aug 02 10:31:01.321808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 889/1791] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:01.500846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:01.502978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:01.504941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:01.510182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.520350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.520350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.520350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.544707 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69e24840-4aa5-439c-9aee-36a5849d729b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047886 Aug 02 10:31:01.545291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 903/1792] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:01.863607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:01.867471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:01.879736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.880471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.882148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:01.882941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:01.919560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9859b55f-da3e-4ae4-8793-8c87d9241bd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062072 Aug 02 10:31:01.920158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 890/1793] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:02.142798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:02.145136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:02.155262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.155968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.157237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.157890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.207592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d2c764cf-e3ee-4bee-9b61-34c4652ff549 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070674 Aug 02 10:31:02.208492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 904/1794] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:02.347561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:02.348287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:02.356291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.356817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.357676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.358198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.501248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:02.509972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7247326a-c43e-4c6a-9933-8f9da2afd502 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.166764 Aug 02 10:31:02.510855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 891/1795] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:02.559800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:02.561952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:02.568462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.568906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.569682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.570121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.601334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56c0747e-9830-4e5c-9e20-545968e3a8fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045599 Aug 02 10:31:02.601906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 905/1796] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:31:02.933005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:02.935283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:02.941598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.942044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.942834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.943301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.976848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88ebc51e-bcb2-4771-8b04-d70454a54482 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Aug 02 10:31:02.977438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 892/1797] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:02 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:03.223498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:03.225854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:03.233863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.234311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.235130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.235672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.273093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a4da0235-6002-480a-adcb-31288867577e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053841 Aug 02 10:31:03.273866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 906/1798] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:03.532250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:03.532853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:03.539549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.539973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.540738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.541166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.614336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:03.620172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:03.623388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.623770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.624494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.624931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.659104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35b147aa-3851-4a85-8b21-4dc52cf72082 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049190 Aug 02 10:31:03.659716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 907/1799] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:31:03.678750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:03.686423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c0f3cb65-9417-4527-98ce-81351d80fa14 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158082 Aug 02 10:31:03.687006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 893/1800] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:03.989365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:03.991576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:03.997779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.998251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.999030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.999502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.030004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db6af03b-330e-45cf-8a63-14b483d7dfba tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Aug 02 10:31:04.030592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 908/1801] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:04.287652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:04.289974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:04.297382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.297859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.298854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.299372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.341835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6dbb068a-3349-43c6-9d64-3ce1898a33a5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059023 Aug 02 10:31:04.348306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 894/1802] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:04.671729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:04.673878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:04.680693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.681167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.681950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.682414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.712057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:04.712880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:04.714905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-05975ab4-f901-4274-896b-1c28ce40b681 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047246 Aug 02 10:31:04.715528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 909/1803] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:04.724026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.724845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.726214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:04.727010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.893020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:04.900499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-305c18e8-41e2-4958-8d92-7fa2395e711c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.192228 Aug 02 10:31:04.901073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 895/1804] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:05.043213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:05.045495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:05.052003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.052445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.053255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.053683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.088008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [c593218d-b5bc-4db6-9b7e-9eaa3c8dcb3d] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:31:05.356737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:05.358998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:05.365649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.366094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.366877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.367462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.399715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c0a5b399-a3ae-43ab-b11f-fa1bc3d1da02 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Aug 02 10:31:05.400295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 896/1805] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:05.728331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:05.730980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:05.737757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.738193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.739003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.739477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.771434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9abc3431-2056-4b7a-afbd-a77ff522e271 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047303 Aug 02 10:31:05.772020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 897/1806] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:31:05.922536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:05.923156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:05.929403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.929851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:05.930635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:05.931066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:06.067489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:06.075139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-19958dee-de76-45ff-b3e8-40f633b0af43 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156596 Aug 02 10:31:06.075724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 898/1807] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:06.096346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [c593218d-b5bc-4db6-9b7e-9eaa3c8dcb3d] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40348. Aug 02 10:31:06.166009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c9e27b0-5a21-4e3b-babf-e2ff8b48299f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/action" status: 200 len: 41375 microversion: 2.1 time: 1.127451 Aug 02 10:31:06.166700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 910/1808] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:31:05 2022] POST /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8/action => generated 41375 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:06.411818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:06.413959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:06.420752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:06.421191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:06.421952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:06.422382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:06.453848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e88e1626-ea14-4d18-bf8c-47394d28758a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Aug 02 10:31:06.454418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 899/1809] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:06.785896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:06.788565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:06.797323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:06.797770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:06.798573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:06.799010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:06.833136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e0fce16-04ff-4177-b266-321b0ed8079b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052284 Aug 02 10:31:06.833710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 911/1810] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:31:07.097130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:07.097676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:07.104593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.105627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.106410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.106849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.247009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:07.255038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1d8d739-188f-42d5-83da-a49b2eec17f3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162292 Aug 02 10:31:07.255651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 900/1811] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:07.467041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:07.469135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:07.476094 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.476542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.477318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.477750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.511309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aff222dd-a6be-411b-9a40-e512119ebf6c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048930 Aug 02 10:31:07.515270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 912/1812] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:07.847574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:07.849815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:07.857482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.857932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.858715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:07.859161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:07.890337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0921fe96-5807-453f-a808-234757558307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046855 Aug 02 10:31:07.890919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 901/1813] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:08.277713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:08.278377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:08.285946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.286449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.287319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.287773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:08.525094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:08.529990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:08.530619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-60f6cd88-1b72-4df9-b121-5f7b098cb9ab tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.257059 Aug 02 10:31:08.538986 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 913/1814] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:08.544377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.564110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.564110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.564110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.577795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5c25f5c6-19ab-4717-a50f-484af8576e8c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057298 Aug 02 10:31:08.578377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 902/1815] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:08.906155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:08.908375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:08.916954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.918644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.919871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:08.920461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:08.958275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f325248b-d0b3-4447-902f-ec18621bbd0f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058177 Aug 02 10:31:08.958864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 914/1816] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:09.559842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:09.560482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:09.567446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.567894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:09.568662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.569097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:09.590355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:09.592574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:09.599620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.600067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:09.600828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.601253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:09.645610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a804885-b06c-4033-8a06-fbfd6207abbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059161 Aug 02 10:31:09.646197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 915/1817] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:09.765429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:09.773499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b657a06-54fe-467d-8a83-598875aa69c8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.218159 Aug 02 10:31:09.774284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 903/1818] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:09.970985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:09.973226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:09.979555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.980557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:09.981382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:09.981815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:10.014178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bfbdeaf9-4c4b-4ae6-bd9f-5bc6e8e0b4e4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047277 Aug 02 10:31:10.014747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 916/1819] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:31:10.659259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:10.661570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:10.669324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:10.669766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:10.670579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:10.671016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:10.675331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:10.702970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c2b7209f-1ea3-4558-be10-14f2d1735f4a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Aug 02 10:31:10.703613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 904/1820] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:10.796350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:10.796927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:10.803514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:10.803963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:10.804730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:10.805158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:10.808013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:10.970149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:10.978062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d7aa29b0-7cb3-4259-98ff-9297ba14be96 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.186395 Aug 02 10:31:10.978618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 917/1821] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:11.026598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:11.028784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:11.035075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.035562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.036338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.036779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.067957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7d397078-efae-4fc7-84d0-3ee5639cdc11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045630 Aug 02 10:31:11.068444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 905/1822] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:11.539402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:11.540383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:11.552712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.553558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.555039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.555887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.718811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:11.720982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:11.727788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.728235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.729010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.729473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.759367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-993a1287-de74-41ca-bb13-745f8a4cd1c5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Aug 02 10:31:11.759935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 906/1823] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:12.000741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:12.001416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:12.008068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.008510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.009279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.009712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.145793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:12.159906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-71e51c9f-b8e7-4028-bf75-7f4e36d155ec tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162647 Aug 02 10:31:12.160983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 907/1824] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:12.169970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:12.173807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:12.185535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.186371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.187838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.188651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.238612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3440c1ee-1901-4807-9bf7-b3785d901d3a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076111 Aug 02 10:31:12.239207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 908/1825] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:12.772853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:12.775156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:12.782496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.782946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.783797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.784184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.814837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dd186c12-ea91-4eaa-8505-5b7858cabfe4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Aug 02 10:31:12.815458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 909/1826] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:13.181976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.182586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.188765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.189205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.189961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.190388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.327243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:13.334907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3cd9f549-0d0e-4c8c-a184-2afb911ab130 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156977 Aug 02 10:31:13.335510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 910/1827] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:13.340737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.342887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.348980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.349425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.350195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.350622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.390447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e4fc2930-2182-4430-9aee-e06d175db21f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053749 Aug 02 10:31:13.390907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 911/1828] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:13.827328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.829465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.836027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.836473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.837229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.837664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.867440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c7bc9cb-bead-4600-93ac-92ee78bbbc57 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 02 10:31:13.867995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 912/1829] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:14.358021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:14.358617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:14.365054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.365503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.366265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.366697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.518100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:14.525851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-122993e8-b2c0-456d-a961-2014e546ee6e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.172667 Aug 02 10:31:14.526418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 913/1830] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:14.531915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:14.534783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:14.540593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.541044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.541821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.542295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.575352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4e646fb8-48ff-4e8c-8629-45b1ef92dac5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047272 Aug 02 10:31:14.575935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 914/1831] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:14.883934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:14.886341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:14.892687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.893142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.893916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.894348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.949862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c5fc8b7f-fa5e-4dbc-81e5-ff96b72879f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069818 Aug 02 10:31:14.950987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 915/1832] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:15.551797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:15.552408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:15.559574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.560019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.560781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.561223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.708581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:15.717152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4bd26b43-7024-4038-8beb-eeb9d631e0da tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169233 Aug 02 10:31:15.717758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 916/1833] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:15.722682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:15.724833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:15.731473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.731914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.732678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.733100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.764159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e22695be-9fa3-4b4d-aba7-4a3a25b617a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045339 Aug 02 10:31:15.764716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 917/1834] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:15.963041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:15.965753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:15.971976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.972427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.973207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.973647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:16.004991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-73adc20c-5add-45ff-9f7f-a3a7ff64be59 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045976 Aug 02 10:31:16.005576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 918/1835] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:16.741881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:16.742506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:16.750726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:16.755131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:16.755131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:16.755131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.116373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:17.124503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e318373-07ce-4204-8428-5e5e751e0104 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.388847 Aug 02 10:31:17.125085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 919/1836] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:17.129876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:17.132051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:17.138929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.139410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.140182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.140617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.174525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:17.184002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fc8a94e1-24f2-4a4f-97ad-9009789dab49 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057458 Aug 02 10:31:17.189906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 920/1837] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:17.194505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:17.198326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:17.211207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.212047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.213464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.214794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.265674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3ba176f0-7e67-41a6-ad2f-f1c886d855e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079018 Aug 02 10:31:17.266251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 921/1838] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:18.146528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:18.147460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:18.154016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.154453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.155233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.155668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.296816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:18.305096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-510ce9b7-be0e-4b4e-8b1e-a788f37443a7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162412 Aug 02 10:31:18.305668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 922/1839] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:18.311088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:18.313329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:18.319862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.320303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.321093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.321522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.354629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-74a5eba8-9fd2-4e10-b231-f26811e9a5f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047857 Aug 02 10:31:18.355773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 923/1840] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:18.360870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:18.363172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:18.369744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.370183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.371545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.371989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.404073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-941858a9-5190-42d3-97e3-3ad6df07bc50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047188 Aug 02 10:31:18.404666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 924/1841] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:19.337847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:19.338556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:19.346820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.347440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.348408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.348971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.501318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:19.509795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b0675fd1-fc47-49e1-bdb4-09bbc457760b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.176897 Aug 02 10:31:19.510367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 925/1842] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:19 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:19.563563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:19.565923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:19.572559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.573004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.573813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.574249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.604504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88aa4264-0aea-409e-b673-1bb07e57171f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093020 Aug 02 10:31:19.605691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 926/1843] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:19.610364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:19.612867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:19.619096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.619586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.620429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:19.620875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:19.650813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97fb4f5b-a237-4675-8bfd-d13106f62fda tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Aug 02 10:31:19.651424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 927/1844] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:20.531352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:20.532021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:20.539130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.539619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.540392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.540821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.678965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:20.688886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b74d2b4-af9e-42bb-80a0-b5341259699e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161341 Aug 02 10:31:20.689619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 928/1845] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:20.695251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:20.697411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:20.703665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.704113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.704888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.705324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.735392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c00c9a6f-fe47-4a04-ad3d-a378e2f9336f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044418 Aug 02 10:31:20.735968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 929/1846] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:20.740696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:20.742848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:20.749361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.749811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.750578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:20.751016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:20.780576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9b94425b-3527-4b54-9b17-1d3ee839c95b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Aug 02 10:31:20.781155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 930/1847] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:21.547667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=31 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:21.593631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=9 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:21.709997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:21.710610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:21.712970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:21.718285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.718730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.719538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.719970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.878974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:21.887685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-158ad8d7-eccb-4668-9f50-10bc1327132d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.181523 Aug 02 10:31:21.888283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 931/1848] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:21.893089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:21.895255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:21.901225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.901680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.902453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.902890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.932428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ba42e235-8101-4e2c-b689-e7d29af944ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043011 Aug 02 10:31:21.933918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 932/1849] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:21.938673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:21.940867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:21.947091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.947574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.948354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.949378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.978808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aa0d7b7f-8edc-414b-ab13-246eef08a4cb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 02 10:31:21.979403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 933/1850] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:22.108860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:31:22.109091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:31:22.843980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:31:22.844562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:31:22.909095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:22.909709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:22.916391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:22.916833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:22.918127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:22.918587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.056618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:23.065026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-103473c5-3b95-47f4-8856-0825b7864369 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.159836 Aug 02 10:31:23.065578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 934/1851] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:22 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:23.070074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:23.072279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:23.078067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.078504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.079278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.079709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.109587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d5d05c0-e8c0-46e4-9752-c53dc168ed32 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042906 Aug 02 10:31:23.110055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 935/1852] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:23.114925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:23.117341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:23.123801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.124244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.124998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.125425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.159623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fd081994-332a-48bf-a706-e85ddd68ea41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048457 Aug 02 10:31:23.160196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 936/1853] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:24.086089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:24.086741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:24.093867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.094311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.095104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.095693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.114951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:24.238629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:24.246136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-65f2c22c-b267-4e61-b1f0-b0a8ebf1a1a5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164032 Aug 02 10:31:24.246701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 937/1854] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:24.251543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:24.253671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:24.260009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.260456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.261240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.261674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.290942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ec7b14e0-4a2a-42ea-bc2a-8852d0d1f3d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043180 Aug 02 10:31:24.291534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 938/1855] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:24.296882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:24.299037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:24.304907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.305348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.306109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.306542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.337023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e83d8ae7-1739-4994-8707-753da75907b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 02 10:31:24.337023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 939/1856] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:25.267589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:25.268292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:25.274891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.275413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.276190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.276628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.408562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:25.416290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7318f269-88d3-4560-8c0e-9ae4981a4f42 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152721 Aug 02 10:31:25.416865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 940/1857] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:25.422130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:25.424294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:25.430210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.430679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.431483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.431923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.461476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7bf5712d-6dd4-4f65-85ca-ff8f22823f75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043068 Aug 02 10:31:25.462036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 941/1858] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:25.467406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:25.469550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:25.475543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.475994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.476769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.477201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.507606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7b11f07b-52d5-4d8d-bf8a-31f4c46c2401 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Aug 02 10:31:25.508424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 942/1859] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:26.440067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:26.440765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:26.447624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.448073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.449441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.449885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.596538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:26.604378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-224017d4-0893-4d2a-b10a-04a6ad78ff68 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169333 Aug 02 10:31:26.605450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 943/1860] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:26.610274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:26.612513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:26.618839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.619313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.620092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.621143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.652615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6769690e-6b62-4417-8b05-07a3858041e7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046049 Aug 02 10:31:26.653626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 944/1861] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:26.658395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:26.660658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:26.669717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.670162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.670928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.671394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.703114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7427764d-9326-4446-b894-f9c860dff7ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Aug 02 10:31:26.703114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 945/1862] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:27.627135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:27.627819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:27.634816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.635272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.636066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.636532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.776569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:27.785281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88a76565-b0e0-46ed-b40e-4b651e6c515c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161885 Aug 02 10:31:27.785774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 946/1863] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:27.790642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:27.795449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:27.801778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.802213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.802979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.803436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.833197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4d193ee3-e575-4b21-a0c1-facaf38089fc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046358 Aug 02 10:31:27.833786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 947/1864] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:27.838312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:27.841319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:27.847051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.847526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.848288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.848716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.879991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-df24ac74-f82d-4ba3-8814-0d6144a8a2ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Aug 02 10:31:27.880561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 948/1865] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:28.807333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:28.807990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:28.814621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.815065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:28.815868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.816308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:28.946000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:28.954401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4206fd58-bdb7-4365-b09c-d731bd2b96a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151092 Aug 02 10:31:28.954969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 949/1866] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:28 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:28.959681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:28.961875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:28.968502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.968952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:28.969727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.970166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:29.000635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a3e382af-f4f7-4b74-89e2-f75bda8e63ce tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Aug 02 10:31:29.001202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 950/1867] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:29.006002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:29.008417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:29.014356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:29.014808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:29.015621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:29.016068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:29.044346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bfd1c839-216c-437f-9f00-f84ca0d48dd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Aug 02 10:31:29.044904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 951/1868] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:29.976064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:29.976712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:29.983793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:29.984234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:29.984991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:29.985420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.122707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:30.130289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11c5a729-c1cb-4255-8f47-93bf30f962be tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158167 Aug 02 10:31:30.130852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 952/1869] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:30.135902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:30.138052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:30.144102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.144544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.145304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.145729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.175513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ef17bc1-9937-4751-8c1d-e69753bfda83 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043492 Aug 02 10:31:30.176063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 953/1870] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:30.180694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:30.182785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:30.188609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.189053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.189804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.190233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.193912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:30.219822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bfc8d0b9-d6f3-48c6-9119-fda44bb027e9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Aug 02 10:31:30.220383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 954/1871] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:31.153367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:31.154039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:31.161404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.161847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.162624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.163054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.298672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:31.306454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-473496a1-76fc-4fb3-a408-0345217e3352 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157363 Aug 02 10:31:31.307032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 955/1872] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:31.312312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:31.314477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:31.320913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.321104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.322129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.322323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.351862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cb224fd-46db-4bca-91e7-8c982a1fa5ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043695 Aug 02 10:31:31.352422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 956/1873] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:31.357611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:31.359796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:31.366067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.366509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.367310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.367751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.399773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1f50917-df81-447a-9d03-ac155f3150ce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Aug 02 10:31:31.400351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 957/1874] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:32.012358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:31:32.012613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:31:32.330303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:32.330946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:32.337153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.337601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.338376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.338811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.477909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:32.486124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1bf26186-51e3-46b9-8629-fa1983438476 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.160498 Aug 02 10:31:32.486686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 958/1875] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:32.491373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:32.493503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:32.500290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.500736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.501505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.502008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.532749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81e915ed-7ab4-4697-90fa-52207361e07a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045004 Aug 02 10:31:32.533320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 959/1876] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:32.537948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:32.540054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:32.545970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.546416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.547179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.547653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.576959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e940d1d9-4361-4c59-badf-d2a0baf525f0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Aug 02 10:31:32.577523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 960/1877] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:33.507834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:33.508774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:33.515626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.516075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.516837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.517272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.654152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:33.661824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a9df85bc-4434-4278-bc14-0771c6ba07dd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157892 Aug 02 10:31:33.662387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 961/1878] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:33.667273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:33.670033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:33.676153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.676601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.677369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.677806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.707236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99d3d243-5075-4cb1-866a-02e7cc788dd7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043792 Aug 02 10:31:33.707792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 962/1879] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:33.712415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:33.715008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:33.721533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.721980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.722756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.723203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.753475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b01930f6-cf2f-4e30-81a6-ebd3b8926d8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Aug 02 10:31:33.754092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 963/1880] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:34.684634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:34.685320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:34.692051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.692492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.693254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.693675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.829038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:34.836829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b4b502e6-cae8-45ab-b2fa-1e56268d7db4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156582 Aug 02 10:31:34.847335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 964/1881] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:34.847335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:34.847335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:34.850684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.851126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.851916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.852346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.892479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3975f568-374c-4dcf-bed1-54f843ee85b7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054003 Aug 02 10:31:34.893071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 965/1882] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:34.897961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:34.901434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:34.909015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.909463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.910253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.910684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.943819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9ca0110-1c97-4cd3-bb24-cc9f04b7ec96 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049658 Aug 02 10:31:34.944410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 966/1883] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:35.859837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:35.859837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:35.865919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:35.866368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:35.867141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:35.867605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:36.005934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:36.013926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-21bd6ec4-0a1e-435e-a7e8-d0f6f098742e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.159753 Aug 02 10:31:36.014486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 967/1884] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:36.019136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:36.021310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:36.027805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:36.028263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:36.029013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:36.029448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:36.058741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ea2a8830-cc99-4e2d-9764-210a6a5eb328 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043199 Aug 02 10:31:36.059313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 968/1885] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:36.063787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:36.065896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:36.071726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:36.072172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:36.072932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:36.073366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:36.102818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-91bc5b08-cb14-40f4-9178-f48ad271642e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Aug 02 10:31:36.103426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 969/1886] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:37.035946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:37.036607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:37.043967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.044410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.045170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.045598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.181477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:37.184965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:37.189595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb70ee63-0a40-45b7-bd88-ccb9e8456db5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157511 Aug 02 10:31:37.195318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 970/1887] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:37.195318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:37.196998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:37.203690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.204143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.204927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.205365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.236493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-27ce2933-ac0d-40f3-96d8-766de827c7a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045287 Aug 02 10:31:37.237160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 971/1888] 10.222.0.49 () {60 vars in 1343 bytes} [Tue Aug 2 10:31:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:31:37.241792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:37.243970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:37.250012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.250526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.251311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:37.251738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:37.282176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7d9ddf90-d8d6-4df6-aad1-0e609613ed20 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Aug 02 10:31:37.282837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 972/1889] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:38.212627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:38.213303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:38.220897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:38.221341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:38.222122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:38.222555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:38.365862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:38.373378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1ff25618-4f14-47da-bc9f-78183ec57271 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164970 Aug 02 10:31:38.373938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 973/1890] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:38.378475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:38.380636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:38.387112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:38.387626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:38.388391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:38.388825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:38.415209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [79480f01-0c2a-4db8-b670-8a5337586330] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:31:39.422395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [79480f01-0c2a-4db8-b670-8a5337586330] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40564. Aug 02 10:31:39.489966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3964a723-b891-4ae3-b63e-61847d35ad71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action" status: 200 len: 37698 microversion: 2.20 time: 1.114955 Aug 02 10:31:39.490621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 974/1891] 10.222.0.49 () {62 vars in 1319 bytes} [Tue Aug 2 10:31:38 2022] POST /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f/action => generated 37698 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:31:39.496612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:39.498964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:39.506215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:39.506665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:39.507470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:39.507908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:39.539808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1d9a83f6-028e-4742-9e38-db8cd123ccef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Aug 02 10:31:39.540372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 975/1892] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:39.545510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:39.546114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:39.552481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:39.552928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:39.553692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:39.554126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:39.686348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:39.694044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-476386f7-42c2-4c81-bd14-5c52da4bbcba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152685 Aug 02 10:31:39.694623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 976/1893] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:39 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:40.553677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:40.556025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:40.563418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:40.563881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:40.564761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:40.565192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:40.595375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-49f219f2-03c2-44b3-90eb-fb6557d0e420 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Aug 02 10:31:40.595939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 977/1894] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:40.716771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:40.717384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:40.723593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:40.724043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:40.724811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:40.725260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:40.857825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:40.865699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-af34d2de-be1b-4367-9efd-a278c7984a6d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153358 Aug 02 10:31:40.866258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 978/1895] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:41.607310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:41.609428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:41.615951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:41.616390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:41.617138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:41.617564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:41.646759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0063deb7-f7d8-49ff-be5b-41b95c7e4cbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Aug 02 10:31:41.647330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 979/1896] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:41.887870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:41.888387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:41.894529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:41.894970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:41.895757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:41.896187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:42.030344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:42.037852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b6bbbc4a-c65d-4a59-9088-61f6141da555 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154254 Aug 02 10:31:42.038413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 980/1897] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:41 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:42.658559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:42.660720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:42.663228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:42.668566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:42.669009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:42.669779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:42.670214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:42.701553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-96d5ccd5-11fc-4276-97ab-0da1d08eee1b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046688 Aug 02 10:31:42.702136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 981/1898] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:43.059594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:43.060203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:43.066283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:43.066724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:43.067509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:43.067944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:43.197075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:43.205072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1567231e-0d10-435e-b6b4-0f6150b96eaa tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.149875 Aug 02 10:31:43.205647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 982/1899] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:43.714156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:43.716367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:43.722963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:43.723446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:43.724501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:43.724937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:43.754676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c8001e7-53bc-471a-8e9b-4667d7bbe6ec tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 02 10:31:43.755244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 983/1900] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:44.226095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:44.226722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:44.235732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:44.236524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:44.237865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:44.238311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:44.378575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:44.386874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bcae1e40-9513-4692-a4b3-4e2e8cb1b41c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164651 Aug 02 10:31:44.387497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 984/1901] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:44.768164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:44.770341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:44.776910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:44.777911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:44.778682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:44.779109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:44.808083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c7d7117e-62ff-49ea-a639-cbbebd92d1d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Aug 02 10:31:44.808565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 985/1902] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:45.408639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:45.409160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:45.415400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:45.415841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:45.416594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:45.417022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:45.557730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:45.567806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-47622206-240b-4270-b062-85d583eee968 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162118 Aug 02 10:31:45.568397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 986/1903] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:45.820696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:45.822817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:45.829381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:45.829839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:45.830578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:45.831011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:45.858682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:45.863323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-428c53bd-3224-4a41-90bb-f6ebfac8ec0d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046625 Aug 02 10:31:45.863963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 987/1904] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:46.591896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:46.592506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:46.607650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:46.608096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:46.608931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:46.609364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:46.744630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:46.752318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e156a21-d907-4863-8078-7c121ee55bd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.165682 Aug 02 10:31:46.756552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 988/1905] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:46 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:46.881114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:46.883161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:46.889906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:46.890344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:46.891105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:46.891563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:46.920379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4871d01d-f927-4c52-9ef7-516b9ed1a865 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Aug 02 10:31:46.920938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 989/1906] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:47.774789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:47.775429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:47.781586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:47.782032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:47.782794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:47.783287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:47.922428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:47.930887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c5cfe95-53cf-40ae-acd7-a19e7b918def tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.159986 Aug 02 10:31:47.931521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 990/1907] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:47.936883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:47.939045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:47.945307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:47.945761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:47.946537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:47.946976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:47.978158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3f817cf9-d038-40fd-8c5a-408cbcfbb842 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045545 Aug 02 10:31:47.978755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 991/1908] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:48.953049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:48.953688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:48.960219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:48.960658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:48.961410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:48.961844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:49.095040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:49.102592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-af9579dd-5de3-4114-bcca-657a030d8092 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.153504 Aug 02 10:31:49.103163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 992/1909] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:48 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:49.107689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:49.109804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:49.115539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:49.115990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:49.116758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:49.117198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:49.146817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-344027f0-04e2-4c3d-8355-7ff2162281d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 Aug 02 10:31:49.147411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 993/1910] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:50.124568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:50.125265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:50.131825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:50.132271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:50.133033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:50.133472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:50.272383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:50.280091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fe437d5b-6aa5-4f05-8bd4-5912bb39b70e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.159402 Aug 02 10:31:50.280664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 994/1911] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:50.285364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:50.287532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:50.293695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:50.294147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:50.294922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:50.295395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:50.325493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-61f596cd-a50d-45c8-ba8c-79fb0dbfeb58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Aug 02 10:31:50.326076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 995/1912] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:51.301726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:51.302530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:51.309096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:51.309545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:51.310306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:51.310748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:51.441926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:51.449676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8592da88-92de-4736-b76f-fbe92f10ab03 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151861 Aug 02 10:31:51.450236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 996/1913] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:51.454861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:51.457029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:51.462995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:51.463474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:51.464246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:51.464683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:51.493642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-58db3077-6ff5-4cc6-b8f2-ac34e90ace91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Aug 02 10:31:51.494203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 997/1914] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:52.471722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:52.472419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:52.478863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:52.479411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:52.480885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:52.481319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:52.622109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:52.629912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ced8ff39-44c2-4d25-8167-39d30cdaa157 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162010 Aug 02 10:31:52.630478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 998/1915] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:52.635551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:52.638458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:52.643755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:52.644205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:52.644980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:52.645466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:52.675241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e9c38fa1-fec7-4ad8-be2d-702d6ae1561c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Aug 02 10:31:52.675803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 999/1916] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:53.652969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:53.653815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:53.660848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:53.661305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:53.662082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:53.662515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:53.806670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:53.815149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5b7beed-7f60-4a00-a93c-c3b6e9b681ca tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.166759 Aug 02 10:31:53.815765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1000/1917] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:53.820455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:53.822623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:53.829271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:53.829701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:53.830485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:53.830929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:53.861074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a3dee511-0cde-48c5-b8ac-e0f8d1404dea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Aug 02 10:31:53.861648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1001/1918] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:54.837427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:54.838082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:54.845078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:54.845532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:54.846287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:54.846719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:54.981497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:54.989340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-753c904b-1e78-4e45-beba-8473c45a40bb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156120 Aug 02 10:31:54.999557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1002/1919] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:54 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:54.999557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:54.999557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:55.003380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:55.003822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:55.004627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:55.005176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:55.034802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fffb20d3-ab1b-43f4-9cfe-432f2979305a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Aug 02 10:31:55.035396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1003/1920] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:56.010591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:56.011283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:56.019124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:56.019607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:56.020378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:56.020816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:56.039086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:56.160525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:56.168257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55a59077-a045-4052-ad65-1c9305c70876 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.161758 Aug 02 10:31:56.168833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1004/1921] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:56.173556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:56.175904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:56.182450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:56.182898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:56.183964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:56.184411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:56.217621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55d374ee-d3de-401e-a86a-ce85849069e6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Aug 02 10:31:56.218207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1005/1922] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:57.190213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:57.190903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:57.197431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:57.198082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:57.198716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:57.204577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:57.333641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:57.341142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-40a6a240-73e2-473f-b75c-f04aa7e063bc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154842 Aug 02 10:31:57.341777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1006/1923] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:57.346210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:57.348323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:57.354058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:57.354497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:57.355825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:57.356257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:57.385592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9434f620-26b8-41c9-9370-801b7e8a2055 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Aug 02 10:31:57.386145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1007/1924] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:58.362639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:58.363425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:58.370096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:58.370548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:58.371938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:58.372381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:58.520013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:58.528483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9a81811f-ec84-4904-bf2f-667a43c172b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.169743 Aug 02 10:31:58.529056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1008/1925] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:58.533888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:58.536106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:58.542674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:58.543839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:58.544476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:58.544910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:58.573908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1c6aed8-7766-4155-8f24-1d4da3939e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Aug 02 10:31:58.574480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1009/1926] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:59.550380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:59.551121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:59.557528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:59.557967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:59.558724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:59.559152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:59.688611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:59.696209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6c045fe-54fb-4095-bad4-fc5fd16b6a33 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.149849 Aug 02 10:31:59.704084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1010/1927] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:59 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:31:59.704084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:59.704084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:59.709758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:59.710200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:59.710952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:59.711404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:59.739505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f30f635b-b635-4b3d-b1f0-a892fd1ced97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 Aug 02 10:31:59.740052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1011/1928] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:00.718457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:00.719133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:00.725739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.726186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.726960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.727434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.864203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:00.871894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d1ef3fad-ff4b-41e9-9a6f-07d4f377e839 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157795 Aug 02 10:32:00.872471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1012/1929] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:00.877132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:00.879320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:00.885826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.886276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.887051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.887513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.918764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b65f9cf-5585-4bce-a42e-0a7b85b49ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Aug 02 10:32:00.919371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1013/1930] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:01.894143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:01.894807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:01.901337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:01.901789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:01.902548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:01.902975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:02.038911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:02.047021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46d93071-0744-46ea-b6ca-7bc3f01b870d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.156888 Aug 02 10:32:02.047605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1014/1931] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:02.052184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:02.054285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:02.060902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:02.061340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:02.062100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:02.062532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:02.091291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6104263d-933b-4937-b63e-d1d91fc268d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Aug 02 10:32:02.091858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1015/1932] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:03.069185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:03.069880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:03.076421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.076874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.077644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.078077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.209151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:03.217904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-69f836f5-b78d-4aac-8294-694d8b0c315f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.152619 Aug 02 10:32:03.218472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1016/1933] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:03.223004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:03.225141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:03.231583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.232032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.232798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.233238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.262504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-10ccdfdf-2513-41d4-851b-b165a2d7c943 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Aug 02 10:32:03.263441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1017/1934] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:04.240043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:04.240771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:04.248233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.248672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.249441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.249863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.386260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:04.393967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a0fbe208-ec54-4399-b8ed-8812447f5cc7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.157882 Aug 02 10:32:04.394534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1018/1935] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:04.399108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:04.401271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:04.407400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.407849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.408614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.409046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.438653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cc7c8ef3-0af5-4d20-8aa9-d705fa38df7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Aug 02 10:32:04.439249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1019/1936] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:05.415250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:05.415972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:05.422951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:05.423436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:05.424203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:05.424640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:05.555182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:05.562804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ee58dbd-069e-4e26-b557-b92bbe890625 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.151565 Aug 02 10:32:05.563397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1020/1937] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:05.567940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:05.570074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:05.576625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:05.577100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:05.577900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:05.578347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:05.582175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:05.607570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9fba9631-1935-4c73-ac1e-dcc5074a0c6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Aug 02 10:32:05.608113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1021/1938] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:06.585560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:06.586258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:06.593966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:06.594407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:06.595178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:06.595634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:06.740434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:06.749439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9c797195-ba1e-4111-8fa8-5f6154910456 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.168873 Aug 02 10:32:06.750043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1022/1939] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:06 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:06.755594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:06.757807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:06.765482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:06.765918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:06.766714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:06.767150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:06.803424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-41da0aa2-9b00-4eba-8c68-09ce7475dd0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Aug 02 10:32:06.803424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1023/1940] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:07.772203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:07.772846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:07.780018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.780468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.781237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.781674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.919274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:07.926957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3d54dc0-6435-42e2-93b1-ff665cf3b5eb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.158691 Aug 02 10:32:07.927566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1024/1941] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:07.932102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:07.934756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:07.940744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.941189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.941958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.942386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.972291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f5ffcf69-78dc-4d45-aa48-9afe564099ad tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 02 10:32:07.972869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1025/1942] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:08.949559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:08.950257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:08.957108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:08.957553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:08.958331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:08.958756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.101421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:09.109802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ee8361dc-77f5-4aaa-ba9e-76b1bd2b8b32 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.164226 Aug 02 10:32:09.110512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1026/1943] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:09.115127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:09.117344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:09.124203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:09.125134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.125478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:09.125823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.164104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c2d76f4d-0de5-4435-aad9-b5b6cf29ae9b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052664 Aug 02 10:32:09.164685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1027/1944] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:10.132113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:10.132739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:10.139481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.139952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.140705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.141138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.275369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:10.282833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-795729cc-b2d3-4ec0-bf69-654621591858 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.154724 Aug 02 10:32:10.283429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1028/1945] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:10.287897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:10.290039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:10.296478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.296920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.297678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.298107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.326918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d27c963e-bed4-4391-8e0b-c265360915ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042445 Aug 02 10:32:10.327496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1029/1946] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:11.304705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:11.305440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:11.312680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.313132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.313899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.314331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.456152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:11.463780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3a8dfb7-a784-4734-92a2-48081581b835 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.162886 Aug 02 10:32:11.464361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1030/1947] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:32:11.469672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:11.471849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:11.473700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:11.479677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.479677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.480038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.480185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.511516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0e438ca1-d92b-4245-b7ca-311be7b7b0c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Aug 02 10:32:11.512120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1031/1948] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:11.593368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:11.593856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:11.600158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.600603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.601370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:11.601801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:21.598066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:21.622150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=68 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:34.289714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:32:34.579807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:32:44.295248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:44.584807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:55.911235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:32:55.911816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:33:11.975644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:33:11.978684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:33:11.980529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:33:11.981474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:33:11.982980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:11.984592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:11.986433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) Aug 02 10:33:11.987861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:33:11.989314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac0f92b6-8f6d-4e3a-86d0-2a75e0c2c8de) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:11.989314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a637e733-c3ff-4b18-aeb4-be79fc58a84b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 60.391063 Aug 02 10:33:11.989314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1032/1949] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:32:11 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 60392 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:33:11.989314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:11.989663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:11.993111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:11.993554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:11.994322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:11.994751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:12.048629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0afad857-2a28-4e54-a5de-607dbb1416e7 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 202 len: 0 microversion: 2.1 time: 120.516001 Aug 02 10:33:12.050125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 918/1950] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:31:11 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 0 bytes in 120520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:33:12.059032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:12.062489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:12.074121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:12.075207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:12.076551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:12.077265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:12.127140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-590433e1-3795-479d-9144-d55670a82b61 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075301 Aug 02 10:33:12.128211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 919/1951] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:33:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:33:12.146206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:33:12.154478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b8544410-a453-447e-951a-d9a82306d4db tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.172812 Aug 02 10:33:12.169324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1033/1952] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:33:12.174646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:12.175398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:12.182541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:12.183211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:12.183984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:12.184569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:12.346067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-527778c1-5e3b-43fc-ad72-18078736f5a9 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] Action: 'create', calling method: .version_select at 0x7f70c2f50f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-536074535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4JH4KXTmVjHSj+kXc2eUy3L1lVOkEwP0RxL0qBqRkVTw6W4saLVJombuP8QzqdV6ByCQoHLOSNCmUADBFcgjlvlxwZ1LYqy6qnxf0/E3W/+8wRt2drDva/BSzbZGTAQA=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:33:12.362136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-527778c1-5e3b-43fc-ad72-18078736f5a9 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] Getting quotas for project e51215bdae404aa6bb5518d13c1fa98b. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:33:12.366045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-527778c1-5e3b-43fc-ad72-18078736f5a9 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] Getting quotas for user c1903928948540839a7104001f844e1d and project e51215bdae404aa6bb5518d13c1fa98b. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:33:12.541785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-527778c1-5e3b-43fc-ad72-18078736f5a9 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.412145 Aug 02 10:33:12.542395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 920/1953] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:33:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:33:13.140234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:33:13.142510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:13.149165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.150112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:13.150870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.151376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:13.260559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-626953b6-6321-4b41-89a9-f5ac837206ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action" status: 200 len: 82588 microversion: 2.1 time: 0.124098 Aug 02 10:33:13.261534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 921/1954] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:33:13 2022] POST /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/action => generated 82588 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:33:13.269723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:13.269723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:13.278021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.278694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:13.279668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.280424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:13.421903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:33:13.429690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-92602e36-5d08-48bb-8a6a-d50836e37dad tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.167221 Aug 02 10:33:13.430254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 922/1955] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:33:13.435534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:13.435983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:13.442077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.446942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:13.446942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:13.446942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:22.178935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:33:22.207165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=10 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:33:22.373000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:33:23.440110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:33:23.463889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:34:34.790499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:34:35.051383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lazy-loading 'services' on Instance uuid 9fb7d6a1-2042-4138-86b7-fdfe501f1081 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:34:42.117354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:34:42.117947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:34:42.852367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:34:42.852922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af (ip 10.222.0.49) !!! Aug 02 10:34:44.794824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:34:45.056322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:34:52.026644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:34:52.027263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:35:12.411515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:35:12.412182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:35:12.413567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.414869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.416389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.418643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.422957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) Aug 02 10:35:12.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.428991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a0fc600-7328-4fd2-b32d-571445369d07) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:35:12.428991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-92497525-29e2-4d61-ade7-ceafcf21d4cc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 120.243142 Aug 02 10:35:12.428991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1034/1956] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:33:12 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 120245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:35:12.428991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.429567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.429567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.429567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.430739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.431433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.459126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.459876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Request method failure captured: Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af HTTP/1.1 Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PsYDKShGI167ILZDb9gUbf2j0qwX8M-hHfFKtdv8Tfgn2Qf98ADkp2mg03ON-mmWJNDYpNk5lJ8bVrS8-necyWe6vpNZHCVsLwKbyzlePZhe9NkMXPvmJIchAs26AR_cizUIAhPNK56EqD6AdaLD_EZH3oq1h751pSQ2EvOgowJJXc Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 4f52a818be854bce9ba1c1405bab4a6c Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:35:12.462018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f52a818be854bce9ba1c1405bab4a6c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 4f52a818be854bce9ba1c1405bab4a6c Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-TestMinimumBasicScenario-1683556588-project Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: c0fc81b95f6d41bf843bf9aadabcda9d Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-TestMinimumBasicScenario-1683556588-project Aug 02 10:35:12.469298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '9fb7d6a1-2042-4138-86b7-fdfe501f1081', 'id': '0f85bba9-3845-4547-8013-d364913fd3af'} Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.470248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.471355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.477141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.479974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) Aug 02 10:35:12.482862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.485397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f52c06a0-21d2-4e10-addb-75abb57f912f) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:35:12.485397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-76138703-ae94-4895-b691-39ee57d07306 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af" status: 400 len: 269 microversion: 2.1 time: 119.031904 Aug 02 10:35:12.485397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 923/1957] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:33:13 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af => generated 269 bytes in 119033 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:35:12.485397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.485943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.490500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.491461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.499560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.499560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.668806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:12.676359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f09f069e-2db0-4ee0-b034-371d1f0d5ee5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.210996 Aug 02 10:35:12.676909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 924/1958] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:12.681415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.681963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.687499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.688000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.689855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.690305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.774249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:35:12.785001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7a87ed7f-ffa5-45eb-871a-3b695252cc7e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 204 len: 0 microversion: 2.1 time: 0.368796 Aug 02 10:35:12.785639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1035/1959] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:35:12 2022] DELETE /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:35:12.792286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.792286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.799259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.799259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.799567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.800136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.833654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:35:12.836407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:35:12.837753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.838385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.839460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.840832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.841953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) Aug 02 10:35:12.843027 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.844113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-860019d6-fbcb-4124-8c55-6bb3a37f38fa) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:35:12.844113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11df9afb-2896-47e0-ad01-7831296ecc72 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 0.160016 Aug 02 10:35:12.844113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 925/1960] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:35:12 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:35:12.845196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.845696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.852290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.852779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.853527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.853959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.883172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:35:12.891979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lazy-loading 'services' on Instance uuid 9fb7d6a1-2042-4138-86b7-fdfe501f1081 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:35:12.951536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.compute.api [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Instance is already in deleting state, ignoring this request Aug 02 10:35:12.952352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83870838-f090-40ee-af2d-6843e485ed79 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 204 len: 0 microversion: 2.1 time: 0.112782 Aug 02 10:35:12.954689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 926/1961] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:35:12 2022] DELETE /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:35:12.957769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:12.958787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:12.969655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.970062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.970846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:12.971022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.971652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Request method failure captured: Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af HTTP/1.1 Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PsYDKShGI167ILZDb9gUbf2j0qwX8M-hHfFKtdv8Tfgn2Qf98ADkp2mg03ON-mmWJNDYpNk5lJ8bVrS8-necyWe6vpNZHCVsLwKbyzlePZhe9NkMXPvmJIchAs26AR_cizUIAhPNK56EqD6AdaLD_EZH3oq1h751pSQ2EvOgowJJXc Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 4f52a818be854bce9ba1c1405bab4a6c Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:35:12.976119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f52a818be854bce9ba1c1405bab4a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f52a818be854bce9ba1c1405bab4a6c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 4f52a818be854bce9ba1c1405bab4a6c Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1683556588 Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-TestMinimumBasicScenario-1683556588-project Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: c0fc81b95f6d41bf843bf9aadabcda9d Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-TestMinimumBasicScenario-1683556588-project Aug 02 10:35:12.992590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '9fb7d6a1-2042-4138-86b7-fdfe501f1081', 'id': '0f85bba9-3845-4547-8013-d364913fd3af'} Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.993485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:35:12.994760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.996495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.997715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) Aug 02 10:35:12.998981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:35:13.002686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc07f1a7-5c5a-4d21-9e1f-9336a995cbf1) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:35:13.002686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8759f5ad-aa6c-4909-8a85-d6d14a0bf094 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af" status: 400 len: 269 microversion: 2.1 time: 0.193060 Aug 02 10:35:13.002686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1036/1962] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:35:12 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081/os-volume_attachments/0f85bba9-3845-4547-8013-d364913fd3af => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:35:13.002686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-20d3031d-19ac-414f-a672-5263413f0ca1 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] Calling method '.version_select at 0x7f70cb471550>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:13.132359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:13.144002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6e4dfb57-8e61-4734-822e-ec4dd1051ebd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.190046 Aug 02 10:35:13.144587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 927/1963] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:12 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:13.150499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:13.159832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:13.161582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:13.162303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:13.162532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-20d3031d-19ac-414f-a672-5263413f0ca1 tempest-TestVolumeBootPattern-567163777 tempest-TestVolumeBootPattern-567163777-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-536074535" status: 202 len: 0 microversion: 2.1 time: 0.180343 Aug 02 10:35:13.162798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:13.163251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:13.164770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1037/1964] 10.222.0.49 () {58 vars in 1260 bytes} [Tue Aug 2 10:35:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-536074535 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:35:13.178391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:13.180414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:13.190910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:13.192096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:13.193149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:13.193760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:13.447953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:13.457628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d47674e2-4b41-41d8-b809-2f0123e2d7a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.284181 Aug 02 10:35:13.458234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1038/1965] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:13 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:14.237607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:14.238442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:14.247402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.247995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.249423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.249965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.279724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:35:14.647711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e88ec23-9a4b-49aa-a122-db4bfa9d9f3b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 204 len: 0 microversion: 2.1 time: 0.414436 Aug 02 10:35:14.649044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1039/1966] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:35:14 2022] DELETE /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:35:14.733098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-52ec4f7b-f13e-4d4b-9903-cfac3c794390 req-a617ec15-dcd0-4d8f-a520-7f4ee36e2eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:35:14.743801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-52ec4f7b-f13e-4d4b-9903-cfac3c794390 req-a617ec15-dcd0-4d8f-a520-7f4ee36e2eb3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.744505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-52ec4f7b-f13e-4d4b-9903-cfac3c794390 req-a617ec15-dcd0-4d8f-a520-7f4ee36e2eb3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.756589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-52ec4f7b-f13e-4d4b-9903-cfac3c794390 req-a617ec15-dcd0-4d8f-a520-7f4ee36e2eb3 service nova] Creating event network-changed:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:35:14.762822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-52ec4f7b-f13e-4d4b-9903-cfac3c794390 req-a617ec15-dcd0-4d8f-a520-7f4ee36e2eb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111995 Aug 02 10:35:14.763780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1040/1967] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:35:14.768927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:14.769637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:14.776352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.782930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.782930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.782930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.929070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:14.938194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc043a30-7753-4030-b0a2-c590fab40cab tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.173105 Aug 02 10:35:14.939005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1041/1968] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:14.943339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:14.943954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:14.957754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.959336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:14.959474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:14.960539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:15.432284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:15.440589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-20757a6c-3168-4f20-86ae-96081232880a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1568 microversion: 2.1 time: 0.500669 Aug 02 10:35:15.455441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1042/1969] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1568 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:15.962712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:15.963380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:15.969435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:15.969883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:15.970651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:15.971082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:16.115236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:16.123921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-42950e0b-9e79-491e-8520-e98fd4a5bd43 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.165654 Aug 02 10:35:16.125093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1043/1970] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:15 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:16.467331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:16.468004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:16.474791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:16.475317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:16.476135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:16.476565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:16.619853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:16.628124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30485c36-527b-40b4-af53-62ab72d8925a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.165123 Aug 02 10:35:16.629580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1044/1971] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:17.146130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:17.147624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:17.157581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:17.158034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:17.159492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:17.159972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:17.305125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:17.316779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2005ca7-e680-46ca-9446-f08fbb247f40 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.174328 Aug 02 10:35:17.317827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1045/1972] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:17 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:17.656690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:17.657306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:17.665787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:17.666883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:17.668145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:17.668706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:17.813204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:17.821662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e196d010-17c2-4afb-b940-67c823f5741b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.168936 Aug 02 10:35:17.822271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1046/1973] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:17 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:18.339228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:18.340084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:18.346425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:18.346875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:18.347738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:18.348178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:18.484192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:18.492987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-04c5b4d8-b244-47e7-aad3-6ede236a98de tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.158560 Aug 02 10:35:18.493514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1047/1974] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:18 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:18.843075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:18.843726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:18.850664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:18.851833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:18.852666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:18.853194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:18.987923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:18.995982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7283483e-5835-4b38-a29b-731de707ded8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156812 Aug 02 10:35:18.996444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1048/1975] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:19.516435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:19.517184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:19.524314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:19.524877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:19.525763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:19.526292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:19.550767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:19.691259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:19.700646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-adf17abc-dab2-4c5c-a6f6-c76e69267084 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.188239 Aug 02 10:35:19.701226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1049/1976] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:19 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:20.018021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:20.018742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:20.026043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:20.026492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:20.027422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:20.027860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:20.179056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:20.187481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6f3a1151-074e-403e-a7f6-e194091597f1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.173738 Aug 02 10:35:20.188075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1050/1977] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:20.723792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:20.725140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:20.733186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:20.734158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:20.735352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:20.736200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:20.902779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:20.911584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dafd29b4-1383-4d61-bbe8-0d9cabdc8c59 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.191368 Aug 02 10:35:20.912249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1051/1978] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:20 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:21.209276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:21.212596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:21.222247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:21.222782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:21.223582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:21.227934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:21.371536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:21.379725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1fb551df-e721-48b7-8e75-64bf64c56cfc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.174281 Aug 02 10:35:21.380304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1052/1979] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:21.934995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:21.935696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:21.941942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:21.942398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:21.943344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:21.943787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:22.074845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:22.082843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-851e47e1-2ceb-4f4e-b3f5-d843cc1b4bb2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.151839 Aug 02 10:35:22.083440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1053/1980] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:21 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:22.402105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:22.402856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:22.409389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:22.409951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:22.410617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:22.411060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:22.553949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:22.561623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f5ee8581-3a6a-430d-b122-c8fa542d2315 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.164191 Aug 02 10:35:22.565666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1054/1981] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:22 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:23.104834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:23.105524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:23.111514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:23.111961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:23.112722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:23.113165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:23.156042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:23.199907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:23.245250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:23.254779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11c050c4-12d2-46fe-9d53-9c5112cfcda9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.153782 Aug 02 10:35:23.255384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1055/1982] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:23 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:23.582853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:23.583490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:23.590542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:23.590985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:23.591783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:23.592218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:23.723339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:23.730774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-20401d9f-dd33-4531-9ffb-0388ab89db7a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.151829 Aug 02 10:35:23.731373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1056/1983] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:24.277397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:24.278077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:24.284053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:24.284500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:24.285251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:24.285691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:24.411663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:24.419705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46cf15ce-e99a-4040-a03d-a0af1493af3a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.146072 Aug 02 10:35:24.420270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1057/1984] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:24 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:24.751933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:24.752544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:24.759917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:24.760361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:24.761120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:24.761544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:24.890632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:24.898692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-080e7b40-1e42-4dbb-9807-99bed9dc00b4 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.150657 Aug 02 10:35:24.899269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1058/1985] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:25.441914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:25.442591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:25.448891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:25.449341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:25.450136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:25.450575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:25.580983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:25.589518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18cbd700-851a-4aab-aa94-f333723a9ef4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.151546 Aug 02 10:35:25.590086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1059/1986] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:25 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:25.919954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:25.920424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:25.926848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:25.927318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:25.928076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:25.928508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:26.060184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:26.067731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6bad970-c1a1-4a59-b3f5-f2b2c365e872 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.151854 Aug 02 10:35:26.068333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1060/1987] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:26.613216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:26.613864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:26.620438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:26.621028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:26.621853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:26.622289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:26.758648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:26.766613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e34758a3-cd5d-40b8-a4cd-afdd4af200d7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.157479 Aug 02 10:35:26.767282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1061/1988] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:26 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:27.090257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:27.090869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:27.097268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:27.097707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:27.098459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:27.098882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:27.229622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:27.237110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99edd9c3-9182-484e-88fe-0c646802eb55 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.150757 Aug 02 10:35:27.237683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1062/1989] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:27.787847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:27.788500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:27.794359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:27.794804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:27.795599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:27.796035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:27.924040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:27.932067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a50dd3ae-75bd-40d9-9a96-5217805ad275 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.148101 Aug 02 10:35:27.932633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1063/1990] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:27 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:28.258070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:28.258691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:28.265207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:28.265659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:28.266424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:28.266860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:28.398197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:28.405832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fcaacc19-b9b7-4154-afb1-bd799d6c0985 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.151942 Aug 02 10:35:28.406404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1064/1991] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:28 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:28.954524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:28.955153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:28.961844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:28.962296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:28.963060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:28.963549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:29.089609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:29.097734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f5b1c38e-48e9-4f51-b6bb-91686d3021b1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147267 Aug 02 10:35:29.098294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1065/1992] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:28 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:29.427485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:29.428101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:29.434747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:29.435180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:29.435971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:29.436411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:29.440429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:29.718806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:29.726493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4638181d-8025-46f9-8f83-b49b7c0a0a15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.302929 Aug 02 10:35:29.727056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1066/1993] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:30.118767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:30.119460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:30.125451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:30.125897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:30.126655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:30.127089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:30.255103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:30.263466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3beb2680-1170-4d3a-a144-3d163747a344 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.148548 Aug 02 10:35:30.264018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1067/1994] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:30 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:30.747904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:30.748520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:30.755360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:30.755809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:30.757228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:30.757665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:30.889480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:30.897722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d738462b-ebb9-464b-8d2b-be8dd46f67c9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153126 Aug 02 10:35:30.898291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1068/1995] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:31.285719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:31.286310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:31.292359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:31.292805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:31.293555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:31.293981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:31.423084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:31.431078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b12f8e0-98f2-4e7f-afd2-8897ede992cb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.149554 Aug 02 10:35:31.431702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1069/1996] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:31 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:31.919285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:31.920190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:31.928445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:31.928899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:31.929674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:31.930154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:32.061701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:32.069787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-45acd841-19df-44d7-9449-c66f6341b637 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153892 Aug 02 10:35:32.070351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1070/1997] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:32.452639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:32.453304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:32.459292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:32.460384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:32.461154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:32.461589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:32.591938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:32.601628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2b7532c5-d260-4b66-99e2-ced38c7925c2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.152804 Aug 02 10:35:32.602615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1071/1998] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:32 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:33.091388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:33.092024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:33.098421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:33.098873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:33.099657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:33.100746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:33.231375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:33.238821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1d62d459-045e-427d-824b-93dfc613687f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.151419 Aug 02 10:35:33.239414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1072/1999] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:33.623474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:33.624158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:33.630296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:33.630734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:33.631595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:33.632028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:33.761448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:33.769436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2a18b53f-0981-4c79-94b2-b57f1d7e3584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.149953 Aug 02 10:35:33.769992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1073/2000] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:33 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:34.259896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:34.260534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:34.266912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:34.267384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:34.268136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:34.268566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:34.398022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:34.405488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6d017247-787d-4595-b517-f97f1426fdd0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.149435 Aug 02 10:35:34.406076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1074/2001] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:34.790180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:34.790800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:34.796945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:34.797400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:34.798175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:34.798634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:34.925222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:34.933755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d7b2719e-4933-42c3-b236-9db4cf0a7007 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147559 Aug 02 10:35:34.937890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1075/2002] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:34 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:35.426749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:35.427413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:35.434619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:35.435073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:35.435873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:35.436309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:35.569412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:35.576920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-05c75114-d653-4f4d-96d2-2377156454cf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.154213 Aug 02 10:35:35.577487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1076/2003] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:35 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:35.956672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:35.957387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:35.961651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:35.965249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:35.965696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:35.966468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:35.966909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:36.100593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:36.108455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4aff86f8-fa1f-4a59-86b7-1ce676728393 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.155813 Aug 02 10:35:36.109016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1077/2004] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:35 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:36.598066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:36.598667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:36.605233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:36.605676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:36.606424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:36.606854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:36.745463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:36.753179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3bc31aa5-0d70-4cdf-b660-5be8d0737284 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.158939 Aug 02 10:35:36.753982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1078/2005] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:36 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:37.130331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:37.131817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:37.137231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:37.137681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:37.138459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:37.138996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:37.270648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:37.279404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ca7189a4-e905-4bb7-ab3e-4942d4ca67af tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.153188 Aug 02 10:35:37.279970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1079/2006] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:37 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:37.776034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:37.776694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:37.783842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:37.784306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:37.785109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:37.785539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:37.920103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:37.928062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11816f3c-c5f6-4fa2-972b-b86c83f7dfa9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156619 Aug 02 10:35:37.928625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1080/2007] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:38.302093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:38.302793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:38.308761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:38.309196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:38.309980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:38.310404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:38.441970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:38.450540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5988fc0a-44c5-499e-a7ec-3e7643fc0e4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.152705 Aug 02 10:35:38.451095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1081/2008] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:38 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:38.948329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:38.948973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:38.955469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:38.955952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:38.956722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:38.957161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:39.085088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:39.088489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:39.093080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b3e5a55f-67a7-481f-980d-fdda8bffe5d7 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.148697 Aug 02 10:35:39.093639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1082/2009] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:39.472065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:39.472811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:39.483762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:39.484204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:39.484991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:39.485425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:39.615605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:39.623480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ba079ac-e160-4bfc-a304-78aa515ace60 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.155269 Aug 02 10:35:39.624427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1083/2010] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:39 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:40.114160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:40.114701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:40.122005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:40.122456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:40.123237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:40.123678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:40.260494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:40.268313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78fa4500-3032-46db-b2f8-6c645200b7f2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.158163 Aug 02 10:35:40.268871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1084/2011] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:40.646245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:40.646943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:40.652863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:40.653312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:40.654076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:40.654512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:40.783785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:40.792274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbd7434a-6333-4c67-aa51-73f417a75abc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150140 Aug 02 10:35:40.792842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1085/2012] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:40 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:41.289971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:41.290613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:41.297151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:41.297600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:41.298361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:41.298793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:41.427110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:41.435360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fc557482-b8fb-4672-a40b-21d2b3c25647 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.149767 Aug 02 10:35:41.435935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1086/2013] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:41 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:41.813645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:41.814275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:41.820659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:41.821104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:41.821862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:41.822303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:41.952726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:41.961273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-28f9fe95-064a-43e0-8b59-d0cc772f09ba tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.151631 Aug 02 10:35:41.961833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1087/2014] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:41 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:42.457003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:42.457618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:42.464698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:42.465151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:42.465918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:42.466357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:42.598116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:42.605556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5baf6c7-ea22-4fa2-a536-cd98aecf66b1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.152592 Aug 02 10:35:42.606109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1088/2015] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:42 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:42.982611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:42.983371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:42.989259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:42.989704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:42.990955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:42.991444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:43.115935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:43.123709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc7cbccb-7a74-4d15-ac0d-fe747f158fb1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.144945 Aug 02 10:35:43.124274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1089/2016] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:42 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:43.626055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:43.626670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:43.634554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:43.634996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:43.635791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:43.636227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:43.768816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:43.776867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-563ea5a2-5b51-431b-83f7-6016d50f7b92 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.154836 Aug 02 10:35:43.777436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1090/2017] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:44.145957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:44.146664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:44.153355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:44.153807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:44.154580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:44.155018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:44.283575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:44.292088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-36384854-f33a-42f0-8a93-4268c0ee0364 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.149996 Aug 02 10:35:44.292682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1091/2018] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:44 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:44.798206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:44.798708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:44.807416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:44.807861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:44.808630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:44.809124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:44.947502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:44.956466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-db967454-4992-45b0-a95f-184507361a47 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.162013 Aug 02 10:35:44.959984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1092/2019] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:45.314536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:45.315220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:45.321834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:45.326797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:45.326797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:45.326797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:45.452595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:45.461053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2cfbe9aa-da36-47e0-ab8e-ac482f175f8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150375 Aug 02 10:35:45.461628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1093/2020] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:45 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:45.978285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:45.978803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:45.985564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:45.986022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:45.986781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:45.987255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:46.122180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:46.129888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb1700ad-623c-4923-865c-a140e5db3775 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.155596 Aug 02 10:35:46.130444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1094/2021] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:46.483460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:46.484126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:46.490178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:46.491357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:46.492157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:46.492589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:46.628617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:46.636874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6179b5db-8dea-4039-a2f9-c3d155641127 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.157488 Aug 02 10:35:46.637452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1095/2022] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:46 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:47.152104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:47.152703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:47.159145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:47.159620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:47.160375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:47.160808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:47.290042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:47.298129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5e6008c3-356d-4796-a930-3a44c6d1386c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.149878 Aug 02 10:35:47.298712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1096/2023] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:47 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:47.657761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:47.658446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:47.665864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:47.666385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:47.667163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:47.667636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:47.805407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:47.813680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e92165f0-7cd4-4197-8dac-6854edb6aff3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.159731 Aug 02 10:35:47.814252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1097/2024] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:47 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:48.320992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:48.321616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:48.328661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:48.329113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:48.329892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:48.330340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:48.465655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:48.473278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7add9be9-88de-4696-ae83-9de304ff6bcf tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156738 Aug 02 10:35:48.473848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1098/2025] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:48 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:48.837297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:48.838017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:48.844063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:48.844509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:48.845286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:48.845729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:48.863739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:48.973347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:48.982229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f061ea1b-dc76-4e65-9d64-c1f01f90f71a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150244 Aug 02 10:35:48.982805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1099/2026] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:48 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:49.495013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:49.495715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:49.502323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:49.502767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:49.503827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:49.504260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:49.638115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:49.645814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ad98542f-b908-45a8-8b9c-e3bd4781bbc1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.154621 Aug 02 10:35:49.646406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1100/2027] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:50.004663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:50.005342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:50.011462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:50.011911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:50.012683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:50.013119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:50.139538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:50.147733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-060aadfe-f839-4ff9-826e-d602b55ad814 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147159 Aug 02 10:35:50.148221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1101/2028] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:49 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:50.668195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:50.668806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:50.675394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:50.675842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:50.676604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:50.677040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:50.810552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:50.818756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c574806a-4ee6-4822-9056-eb2ebf7a9a99 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153909 Aug 02 10:35:50.819381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1102/2029] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:51.169068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:51.169718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:51.175627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:51.176076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:51.176832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:51.177265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:51.304337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:51.312210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-90bd296b-a408-47be-950f-ccee422a7914 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147123 Aug 02 10:35:51.312779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1103/2030] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:51 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:51.840368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:51.840892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:51.847408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:51.847859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:51.848609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:51.849041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:51.985220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:51.993217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a220d50c-47a4-43d8-a919-78769f77776e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156910 Aug 02 10:35:51.993788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1104/2031] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:52.334898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:52.335593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:52.341539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:52.341986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:52.342740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:52.343173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:52.469031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:52.476892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f0a5af61-2cf7-4aae-948e-ec10bb00b472 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.146563 Aug 02 10:35:52.477454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1105/2032] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:52 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:53.014872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:53.015519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:53.022217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:53.022661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:53.023459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:53.023898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:53.158914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:53.166883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb156ca1-92ec-4708-8f5c-08112c39ed10 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.155995 Aug 02 10:35:53.167487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1106/2033] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:53 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:53.497473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:53.498230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:53.504777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:53.505228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:53.506021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:53.506460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:53.639033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:53.649457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bae0f298-cd49-44aa-82cd-b68062d39cd9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.155912 Aug 02 10:35:53.650460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1107/2034] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:53 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:54.194917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:54.195557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:54.202092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:54.202531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:54.203313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:54.203750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:54.335059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:54.342592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f9eb6d35-3f65-4409-a0bc-fc3eb09c5b07 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.154717 Aug 02 10:35:54.343089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1108/2035] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:54 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:35:54.673424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:54.674103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:54.679975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:54.680418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:54.681171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:54.681602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:54.814632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:54.823120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-72b23e8e-7d5d-458e-bbdf-5cd73eb0baf3 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.153671 Aug 02 10:35:54.823711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1109/2036] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:54 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:55.363165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:55.363897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:55.371165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:55.371638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:55.372390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:55.372818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:55.504768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:55.512630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-61da101c-6f33-462c-b258-63216ae8e49b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153303 Aug 02 10:35:55.513200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1110/2037] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:55.845071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:55.845714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:55.851597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:55.852052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:55.852816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:55.853251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:55.981780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:55.989741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9860301e-da12-44fc-8a73-4c3e835f091e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.148674 Aug 02 10:35:55.990814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1111/2038] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:55 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:56.534116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:56.534726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:56.541986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:56.542430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:56.543213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:56.543662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:56.678881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:56.686445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0d1ac666-e4f6-41fe-ac7a-5c4d7ee074fe tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156372 Aug 02 10:35:56.695502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1112/2039] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:57.012870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:57.013614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:57.020459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:57.020911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:57.022238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:57.022675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:57.148566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:57.156595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93ae8425-aa5c-4d70-87ba-bd1e78f29758 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.148149 Aug 02 10:35:57.157169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1113/2040] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:57 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:57.715323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:57.837548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:57.837548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:57.837548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:57.837548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:57.838932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:57.863097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:57.870681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5aaccdca-909e-4021-8788-7961bda5fcef tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.159412 Aug 02 10:35:57.871260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1114/2041] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:58.178635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:58.179324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:58.185240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:58.185693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:58.186466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:58.186901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:58.320548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:58.328609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-05dad621-d423-4a03-82d3-739d99ac0468 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.154469 Aug 02 10:35:58.329174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1115/2042] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:58 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:58.892421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:58.892945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:58.899506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:58.899978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:58.900741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:58.901165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:58.905154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:35:59.034179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:59.042321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-349c1d20-9f1e-40fd-9d0c-21d1d06241a9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153906 Aug 02 10:35:59.042881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1116/2043] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:35:59.350458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:35:59.351256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:35:59.357259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:59.357780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:59.358576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:35:59.359075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:35:59.492013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:35:59.500428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f7f084a1-1216-4408-b3bd-4ad07bf97b6c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.154393 Aug 02 10:35:59.500998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1117/2044] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:35:59 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:00.064062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:00.064674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:00.071767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:00.072219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:00.072971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:00.073406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:00.203406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:00.211617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81d8d18e-dece-42c7-9e52-b24d8a8239ed tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.151484 Aug 02 10:36:00.212189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1118/2045] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:00.522841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:00.523547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:00.529654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:00.530111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:00.530897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:00.531368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:00.663460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:00.671473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46bfbf1c-42f8-4a4c-a896-05b541906edb tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.153086 Aug 02 10:36:00.672053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1119/2046] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:00 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:01.233513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:01.234036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:01.241133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:01.241573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:01.242326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:01.242757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:01.374493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:01.382740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d7fea1d2-2827-484f-ae1d-9da2c494cddb tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153148 Aug 02 10:36:01.383337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1120/2047] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:01.692784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:01.693463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:01.699355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:01.699798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:01.700549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:01.700983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:01.835593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:01.844293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ecf4a319-c7cb-45cc-b69e-3f8561d87d89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.155277 Aug 02 10:36:01.844863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1121/2048] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:01 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:02.403828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:02.404434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:02.411163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:02.412125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:02.412875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:02.413304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:02.543052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:02.550434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9bd307af-e9f1-46b2-b9a3-4e8bedeb7089 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.150547 Aug 02 10:36:02.550994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1122/2049] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:02.865652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:02.866363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:02.872235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:02.872684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:02.873446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:02.873883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:03.000927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:03.009610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30bfd4b3-8cd7-4bac-90ed-0997ce9f83f0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147833 Aug 02 10:36:03.010171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1123/2050] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:02 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:03.571876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:03.572489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:03.578980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:03.579460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:03.580218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:03.580650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:03.715855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:03.723347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-abbb2344-b6c5-4ea2-a8bf-0beae279d18d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156109 Aug 02 10:36:03.723911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1124/2051] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:04.032171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:04.032876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:04.038876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:04.039375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:04.040133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:04.040567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:04.172415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:04.180986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4104fbe2-684f-4af7-95ef-aab201325e4c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.152667 Aug 02 10:36:04.181561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1125/2052] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:04 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:04.746257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:04.746878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:04.753983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:04.755031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:04.755436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:04.755878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:04.895304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:04.903476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8f0d3264-7617-4a7c-a55e-35821216652d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.161203 Aug 02 10:36:04.904038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1126/2053] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:05.202978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:05.203688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:05.206355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:36:05.210391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:05.210834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:05.215408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:05.215408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:05.342462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:05.350659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-44c1d790-51a8-4e01-b29b-503231673e3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.151620 Aug 02 10:36:05.351355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1127/2054] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:05 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:05.925884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:05.926416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:05.934179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:05.934626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:05.935443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:05.935877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:06.080688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:06.088694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6a92a64-a97b-4526-89dd-ea80fcea6b8e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.166735 Aug 02 10:36:06.089281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1128/2055] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:05 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:06.371996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:06.372726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:06.378847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:06.379322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:06.380080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:06.380512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:06.510113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:06.519090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75c23292-6708-4fb1-964f-c2ba8a54ff22 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150872 Aug 02 10:36:06.520032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1129/2056] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:06 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:07.110061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:07.110582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:07.117741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:07.118189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:07.118956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:07.119426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:07.250185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:07.258683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4f41416f-8f49-41a8-b865-605fc3c0a1c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.152628 Aug 02 10:36:07.259260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1130/2057] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:07.541748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:07.542397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:07.548671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:07.549114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:07.549910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:07.550343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:07.681925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:07.689897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-43a6e5f2-33f8-4741-8f4b-e3e71ec903a1 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.152033 Aug 02 10:36:07.690456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1131/2058] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:07 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:08.279750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:08.280362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:08.287031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:08.287520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:08.288296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:08.288712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:08.424565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:08.428489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:36:08.432884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5ed3a9ad-610b-4cf4-9d0f-00a47d46fe34 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.157130 Aug 02 10:36:08.433453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1132/2059] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:08.712183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:08.712872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:08.719917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:08.720615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:08.721388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:08.721818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:08.850301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:08.858190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-35a16d55-917d-4052-b35b-977fbfd143fa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150797 Aug 02 10:36:08.858788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1133/2060] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:08 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:09.454946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:09.455582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:09.462238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:09.462684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:09.463477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:09.463909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:09.797624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:09.807367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-48b110d2-b82f-4d62-97be-4451c10f3a4b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.356140 Aug 02 10:36:09.808005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1134/2061] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:09.880314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:09.881023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:09.887213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:09.887677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:09.888479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:09.888911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:10.016126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:10.023972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9c50ddfa-43ec-4bd5-8547-3cd440f543e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.148985 Aug 02 10:36:10.024532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1135/2062] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:09 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:10.829032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:10.829757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:10.836693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:10.837139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:10.837897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:10.838332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:10.970936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:10.979391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9b4305ba-8b4f-449e-aa5e-13813a96e2c2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.154147 Aug 02 10:36:10.979977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1136/2063] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:10 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:11.044853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:11.045468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:11.051462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:11.052008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:11.052776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:11.053216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:11.183595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:36:11.191640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a74cad26-e972-48ab-be3d-9ff6ce1dce65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.150499 Aug 02 10:36:11.192720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1137/2064] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:36:11 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:36:11.836092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:36:11.836718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:36:11.843098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:11.843580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:11.844360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:36:11.844796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:36:15.920117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:36:15.920721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:36:21.841134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=22 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:36:21.863352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=34 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:36:36.354407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:36:36.656822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:36:46.358769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:36:46.661968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:13.228129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:37:13.230281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:37:13.231905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:37:13.232921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:37:13.234654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.238548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:37:13.239967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) Aug 02 10:37:13.241446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.242849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dc7a8196-2f68-478f-b185-d39eccc59a9c) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:37:13.242849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e69392d-1a78-4788-8273-a2816d486afb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 120.085840 Aug 02 10:37:13.242849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 928/2065] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:35:13 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 120087 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:37:13.242849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.243167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.245989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.246440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.247238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.248039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.264464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:37:13.267049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:37:13.270497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:37:13.273699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:37:13.275910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.278327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:37:13.280713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) Aug 02 10:37:13.283760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:37:13.287400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89ec25c-b6a5-42d5-8a1a-bf3899cecf3b) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:37:13.287400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0969ec91-4e15-4c7e-aca8-29848021c79e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 61.438493 Aug 02 10:37:13.287400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1138/2066] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:36:11 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 61441 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:37:13.287400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.287930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.291962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.292504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.293349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.293875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.396603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:13.405072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c0ca3e4c-4ceb-40e0-aa1d-211f0b740ac6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.171581 Aug 02 10:37:13.405952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 929/2067] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:13.412517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.413360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.420251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.420988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.421767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.422137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.442311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:13.450235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-35d39ebd-52db-4922-9f55-a725d8c77f89 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.177842 Aug 02 10:37:13.450848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1139/2068] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:13 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:13.455511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.456097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.462900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.463391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.464149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.464575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.593843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:13.601850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7a046533-bfe6-4240-a4b8-5ea7d5cc7e38 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.149841 Aug 02 10:37:13.602399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1140/2069] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:13.606738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.607361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.612992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.613435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.614183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.614616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.743217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:13.751148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3df865c1-8df7-4ca4-bf6a-0eadc9c37c9c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147811 Aug 02 10:37:13.752004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1141/2070] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:13 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:13.756886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:13.757381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:13.763094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.763578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.764344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:13.764782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:13.790234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:37:14.059740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ad81e616-8868-4fe4-b5d4-5daf82be5f8c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 204 len: 0 microversion: 2.1 time: 0.306422 Aug 02 10:37:14.060388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1142/2071] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:37:13 2022] DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:37:14.068871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:14.070084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:14.075647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.076100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.076925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.077362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.209605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:14.217741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-277b84f5-b0c6-4896-912d-e9c17995a4e6 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1727 microversion: 2.1 time: 0.152810 Aug 02 10:37:14.218304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1143/2072] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:14.623529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:14.624237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:14.632573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.633052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.633830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.634328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.766316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:14.774741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f49390c5-b6fe-4024-a310-76e950692f2b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.155344 Aug 02 10:37:14.775336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1144/2073] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:14.779891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:14.780500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:14.786306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.786746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.787537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:14.787976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:14.921161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:14.931001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9168550-4777-4e87-8449-b3e408b39ad8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.153894 Aug 02 10:37:14.932230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1145/2074] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:15.240100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:15.240836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:15.247306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.247760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:15.248575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.249016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:15.388285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:15.397004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5d833fc0-7a1e-4234-84c7-beed22951a14 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1727 microversion: 2.1 time: 0.160898 Aug 02 10:37:15.397796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1146/2075] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:15.795597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:15.796243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:15.804094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.804549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:15.805326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.805812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:15.952724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:15.961754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b4c8cc75-7951-442e-a6a0-5fd75aad6005 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.170093 Aug 02 10:37:15.962352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1147/2076] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:15.967141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:15.967782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:15.974544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.977882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:15.977882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:15.977882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:16.116819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:16.126986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b001173a-00c1-4a5d-a6e8-7aa4df6c4bfc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.163350 Aug 02 10:37:16.127614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1148/2077] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:15 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:16.418078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:16.418721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:16.424719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:16.425674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:16.426439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:16.426865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:16.493184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:16.509989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b583dec9-7268-4bfe-98d4-df11adf01fa2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1659 microversion: 2.1 time: 0.095651 Aug 02 10:37:16.511084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1149/2078] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1659 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:16.587957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-c446baac-577e-40ba-91e3-1b9782cfe42c req-dafe61b9-45ae-4b6c-8e3c-83716a442d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8", "name": "network-vif-deleted", "tag": "0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:37:16.598648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-c446baac-577e-40ba-91e3-1b9782cfe42c req-dafe61b9-45ae-4b6c-8e3c-83716a442d77 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:16.599231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-c446baac-577e-40ba-91e3-1b9782cfe42c req-dafe61b9-45ae-4b6c-8e3c-83716a442d77 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:16.615002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-c446baac-577e-40ba-91e3-1b9782cfe42c req-dafe61b9-45ae-4b6c-8e3c-83716a442d77 service nova] Creating event network-vif-deleted:0965200d-50b6-4bb1-9bd6-db5d8ad6bbd9 for instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 on hv-cinder-84753 Aug 02 10:37:16.621711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-c446baac-577e-40ba-91e3-1b9782cfe42c req-dafe61b9-45ae-4b6c-8e3c-83716a442d77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108843 Aug 02 10:37:16.622499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1150/2079] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:37:16.984493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:16.985193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:16.991858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:16.992309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:16.993088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:16.993526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:17.133346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:17.141581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-920fb71c-82a0-4e24-b190-dd172ea7987c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.161992 Aug 02 10:37:17.142382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1151/2080] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:17.159781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:17.160447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:17.166730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:17.167225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:17.168029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:17.168468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:17.300472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:17.317241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-47a85f29-ae65-4720-9d58-072de60cac65 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.160702 Aug 02 10:37:17.329342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1152/2081] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:17 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:17.533431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:17.533659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:17.541015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:17.541467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:17.542237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:17.542674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:17.611309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:17.620395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3164f080-7c0a-4f31-aef0-d38814f34553 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.091209 Aug 02 10:37:17.625933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1153/2082] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:18.164007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:18.165197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:18.172390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.172850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.173642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.174080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.197560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:18.323678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:18.331272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c0a94172-d5b8-460f-b7fd-71061ebf69f6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.172287 Aug 02 10:37:18.331847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1154/2083] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:18.338337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:18.338949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:18.345203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.345657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.346434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.347418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.479979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:18.488819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b003d14d-f3fe-4252-b687-a81e971ae33a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.154167 Aug 02 10:37:18.489390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1155/2084] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:18 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:18.641666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:18.642287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:18.649040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.649491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.650266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:18.650702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:18.716257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:18.725193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-925beb5d-ebf5-4092-8e8e-50884040f1bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.087286 Aug 02 10:37:18.725728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1156/2085] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:19.352465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:19.353260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:19.359854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.360309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.361078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.361518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.502053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:19.510068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b95ab5a8-edfe-4367-bc24-9102ec647f22 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.161409 Aug 02 10:37:19.510647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1157/2086] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:19 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:19.515172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:19.515794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:19.522541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.522986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.523911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.524371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.651513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:19.660026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a7fd283e-c4fd-4d1b-ab39-2b96a35eae5d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.147802 Aug 02 10:37:19.660589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1158/2087] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:19 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:19.746052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:19.746665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:19.753466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.753906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.754656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:19.755092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:19.819492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:19.827837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6210aa84-0d2d-4283-aaa2-321ebd7e55e9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.085695 Aug 02 10:37:19.828426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1159/2088] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:19 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:20.533578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:20.534566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:20.541383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:20.541837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:20.542648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:20.543158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:20.897787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:20.905421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-68dd171c-8009-47d1-955e-0f6d1f061536 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.376804 Aug 02 10:37:20.905910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1160/2089] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:20 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:20.910661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:20.911292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:20.917295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:20.918099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:20.918533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:20.918967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:21.056361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:21.064801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3f2bb25-b03a-4ebe-b958-e2ba5a9a576e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.157837 Aug 02 10:37:21.065939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1161/2090] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:20 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:21.073177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:21.073177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:21.077561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:21.078008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:21.078783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:21.079243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:21.146650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:21.154598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8aa68070-6173-4cb4-ab25-55cca905433b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.087705 Aug 02 10:37:21.155165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1162/2091] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:21 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:21.926160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:21.927762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:21.934640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:21.935076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:21.935885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:21.936320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:22.068292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:22.076033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5f93810a-72dd-4e85-9807-5019a7e043e2 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.153856 Aug 02 10:37:22.076606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1163/2092] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:21 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:22.087310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:22.087908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:22.093889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:22.094336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:22.095095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:22.095561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:22.231525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:22.243278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-65dee814-a55e-4dd1-9b5f-0a0da767bf3b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.159750 Aug 02 10:37:22.243866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1164/2093] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:22 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:22.248422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:22.249030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:22.255834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:22.256281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:22.257052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:22.257493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:22.319783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:22.327748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d52bee13-0fe1-4b0d-9264-3e5f3c392807 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.082893 Aug 02 10:37:22.328341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1165/2094] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:22 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:23.098690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:23.099716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:23.105986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.106426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.107180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.107634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.243507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:23.251038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c1a1792e-3d59-4d13-8a60-4005a4f25f2c tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156742 Aug 02 10:37:23.251894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1166/2095] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:23 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:23.265977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:23.266584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:23.273169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.273606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.274358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.274794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.405932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:23.414707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-15ced2f3-61e2-4acc-9afa-4f4143293017 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.152527 Aug 02 10:37:23.415295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1167/2096] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:23 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:23.418373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:23.419731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:23.420338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:23.426854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.439352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.439352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:23.439352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:23.442139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:23.492262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:23.500409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b086af3-fb55-4448-bdd7-2036be9fda82 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.084153 Aug 02 10:37:23.500967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1168/2097] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:23 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:24.272661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:24.273337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:24.279975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.280424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.281198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.281634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.421399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:24.431469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7a1bb238-b3c4-4105-a102-ad1594b87b15 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.162670 Aug 02 10:37:24.432291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1169/2098] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:24 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:24.436875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:24.437425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:24.443578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.444325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.445113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.445556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.581488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:24.589841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-47df13c3-d961-4fa7-89fc-fe9ab506bc93 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.156563 Aug 02 10:37:24.590422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1170/2099] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:24 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:24.595235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:24.595867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:24.603242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.603698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.604480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:24.604919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:24.611215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:24.673553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:24.682133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7780796b-19cf-4c31-b90f-0b73d67055a8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.090673 Aug 02 10:37:24.682730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1171/2100] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:24 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:25.453140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:25.453830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:25.461154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.461602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.462392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.462834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.598443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:25.606160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ed404281-dbb0-42fb-b494-551b38e53874 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156917 Aug 02 10:37:25.606737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1172/2101] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:25 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:25.613747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:25.614420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:25.620592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.621121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.621897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.622338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.763089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:25.772158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e5d572af-9893-418a-8208-05090699f683 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.162626 Aug 02 10:37:25.772746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1173/2102] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:25 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:25.777485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:25.778090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:25.785271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.785845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.786851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:25.787340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:25.852368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:25.861406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aca90e4d-7435-4827-9a7b-8413efe7a6c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.087695 Aug 02 10:37:25.861971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1174/2103] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:25 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:26.629072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:26.629894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:26.636895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:26.637342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:26.638119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:26.638557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:26.782670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:26.791847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-940fc0e7-de32-4bb0-9458-396339e60a5b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.167033 Aug 02 10:37:26.792439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1175/2104] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:26 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:26.797899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:26.798508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:26.805281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:26.805740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:26.806520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:26.806958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:26.978418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:26.986702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-975cc005-fc02-429d-9c2c-e3f0164a1ef2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.192426 Aug 02 10:37:26.987386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1176/2105] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:26 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:26.991922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:26.992529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:26.998960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:26.999435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:27.000207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:27.000641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:27.069205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:27.079222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7532ab30-114d-4eb7-bf13-f5c17043137a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.090787 Aug 02 10:37:27.079813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1177/2106] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:26 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:27.816471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:27.817198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:27.824598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:27.825045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:27.825836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:27.826271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:27.974329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:27.986374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f30f4352-7125-4422-8ba6-11b1a58bf43d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.173831 Aug 02 10:37:27.987503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1178/2107] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:27 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:28.010140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:28.010842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:28.017314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:28.017755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:28.019099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:28.019561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:28.155318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:28.163788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-be17d2fc-066b-4489-94b1-e9a1de096f3c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.157595 Aug 02 10:37:28.164367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1179/2108] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:28 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:28.169004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:28.169611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:28.176369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:28.176812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:28.177584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:28.178014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:28.240971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:28.249546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a4e1bee4-14bb-4e2d-ab2d-17a747289946 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.084172 Aug 02 10:37:28.250120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1180/2109] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:28 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:29.009176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:29.009922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:29.016789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.017232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.018605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.019043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.154579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:29.162791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d52808f3-cae2-4109-a922-4034989bb6e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.157499 Aug 02 10:37:29.163408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1181/2110] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:29 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:29.187327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:29.187941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:29.194987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.195470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.196393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.196828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.350753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:29.359156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6d581821-f63e-4a3a-aa2c-285784c75a15 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.175720 Aug 02 10:37:29.359801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1182/2111] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:29 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:29.364968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:29.365582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:29.371973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.372539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.373189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:29.373636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:29.440884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:29.449586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d416c8b2-57cc-411f-ab8a-9b88f7e2eb09 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.088729 Aug 02 10:37:29.454118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1183/2112] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:29 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:30.185059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:30.185821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:30.193072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.193510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.194275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.194721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.350162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:30.358520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-680ac63c-a8ff-481e-bd09-94003f7fdea8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.177514 Aug 02 10:37:30.359099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1184/2113] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:30 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:30.384761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:30.385498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:30.388536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:30.392113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.392566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.394732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.395179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.536956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:30.545126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-be64b964-2e1d-4050-b862-5dd4df12794d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.164320 Aug 02 10:37:30.545703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1185/2114] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:30 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:30.550666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:30.551294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:30.557368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.557809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.558569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:30.559000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:30.622238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:30.635030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc6aa1cc-7cc5-4ec9-9438-dae6ae13c586 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.088059 Aug 02 10:37:30.635922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1186/2115] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:30 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:31.383975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:31.384674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:31.391376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.391820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.392577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.393008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.532621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:31.536497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:31.540712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4e33f81c-cce7-44f8-b13a-394d6a03d18f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.162297 Aug 02 10:37:31.541290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1187/2116] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:31 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:31.568218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:31.568738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:31.574934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.575357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.576128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.576628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.710646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:31.719112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e2c39e5c-e05f-4ee5-ad88-0f5b8facc726 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.155555 Aug 02 10:37:31.719722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1188/2117] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:31 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:31.725004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:31.725611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:31.731484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.731892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.732654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:31.733093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:31.795978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:31.804631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c90d36ee-7f3a-435b-8fd0-f0b674e55a40 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.083902 Aug 02 10:37:31.805207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1189/2118] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:31 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:32.562453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:32.563265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:32.570714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.571168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.571980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.572422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.707349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:32.715219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8ee2bd92-4482-4080-ab3a-b553233ee9cd tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.156603 Aug 02 10:37:32.715882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1190/2119] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:32 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:32.742017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:32.742661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:32.749173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.749689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.750640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.750804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.893563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:32.901733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e7cb33af-f457-40b0-83a7-d455ce959c4f tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.164026 Aug 02 10:37:32.902422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1191/2120] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:32 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:32.907068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:32.907744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:32.913710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.914146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.914904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:32.915360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:32.980715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:32.992282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a7d6e0c-545c-43a9-8d61-e0b847e92e2e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.088773 Aug 02 10:37:32.992875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1192/2121] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:32 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:33.736962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:33.737647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:33.744470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:33.744921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:33.745708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:33.746144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:33.905458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:33.914117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-26eea8a9-72d7-446d-91c9-2dba3dacc30f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.181091 Aug 02 10:37:33.914998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1193/2122] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:33 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:33.924273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:33.924992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:33.931682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:33.932145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:33.932927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:33.933359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:34.073974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:34.082862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c1b28fa2-8fb4-4b82-a390-8d24d3c60b34 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.162633 Aug 02 10:37:34.083477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1194/2123] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:33 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:34.263245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:34.263872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:34.271179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:34.271553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:34.272359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:34.272795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:34.343981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:34.352804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-afc84708-f1b6-4650-ab31-c187eab1527b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.268243 Aug 02 10:37:34.353398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1195/2124] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:34 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:34.944882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:34.945658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:34.952933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:34.953382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:34.954210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:34.954640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:35.095378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:35.104251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7f50a1a7-42e6-4701-8a13-5759196dd305 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.168056 Aug 02 10:37:35.104958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1196/2125] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:34 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:35.114426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:35.115686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:35.127351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:35.128176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:35.130172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:35.131009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:35.271128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:35.279548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-356487ef-4888-4318-98c9-d1d40df6644d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.173126 Aug 02 10:37:35.280139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1197/2126] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:35 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:35.375395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:35.376322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:35.384849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:35.385577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:35.386842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:35.387430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:35.463825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:35.479043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2651472c-205f-41f3-8aee-981f08565525 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.108366 Aug 02 10:37:35.479814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1198/2127] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:35 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:36.139779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:36.140545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:36.148220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.148665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.149456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.149894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.297510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:36.306344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de40e14d-f1c1-4b3a-a0b4-26526c12a159 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.170664 Aug 02 10:37:36.306933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1199/2128] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:36 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:36.311760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:36.312377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:36.319502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.319949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.320733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.321604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.487167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:36.496667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5083d6e7-ecbe-426f-b5f4-0c7236340e2c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.188478 Aug 02 10:37:36.497416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1200/2129] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:36 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:36.507289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:36.508663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:36.521611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.522411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.523874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:36.524684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:36.596988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:36.605895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d26c700d-a594-45eb-b13d-6e5b1b6f364a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.106838 Aug 02 10:37:36.606482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1201/2130] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:36 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:37.341458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:37.342373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:37.350548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.351127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.352051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.352577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.516143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:37.525081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-281979c5-d169-4f98-8b91-0f1c93dd7605 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.187527 Aug 02 10:37:37.525754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1202/2131] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:37 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:37.536441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:37.537271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:37.544993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.545596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.546614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.547215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.698925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:37.708674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0c0fcec9-a93c-4cec-bab1-fdeccf3614e8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.178921 Aug 02 10:37:37.709336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1203/2132] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:37 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:37.714825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:37.715651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:37.723034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.723637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.724633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:37.725233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:37.745997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:37.799172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:37.808027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75c0410d-5804-485d-80ec-085f9f9c2284 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.097506 Aug 02 10:37:37.808981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1204/2133] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:37 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:38.557047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:38.558175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:38.570602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.571428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:38.572852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.573575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:38.745761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:38.754495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-589b99a0-e0b1-4d0e-9a63-bd565e9036e1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.206362 Aug 02 10:37:38.755249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1205/2134] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:38 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:38.760023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:38.760644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:38.767659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.768108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:38.769399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.769837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:38.920888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:38.929995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c9e8fa4-df24-478b-9206-5b63f9710ee2 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.173776 Aug 02 10:37:38.930593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1206/2135] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:38 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:38.935532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:38.936277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:38.942933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.943444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:38.944296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:38.944676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:39.018251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:39.027970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-77f51ab9-807a-43d6-be25-bb4c087e3292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.096276 Aug 02 10:37:39.028565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1207/2136] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:38 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:39.777689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:39.778518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:39.785382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:39.785835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:39.786633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:39.787076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:39.954904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:39.967101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ccfa0c88-6101-45a4-9ca7-165381d19c59 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.192993 Aug 02 10:37:39.968009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1208/2137] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:39 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:39.976439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:39.977598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:39.989783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:39.990730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:39.992244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:39.993035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:40.147833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:40.156600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbee6c3a-2626-4af8-905a-19f8f1ab6930 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.187203 Aug 02 10:37:40.157220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1209/2138] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:39 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:40.163291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:40.163650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:40.170335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:40.170793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:40.171641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:40.172082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:40.244660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:40.253681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-54d0765c-233a-4c55-bfe2-ce7e10a8f6c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.095356 Aug 02 10:37:40.254600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1210/2139] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:40 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:40.989865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:40.990645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:40.998965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:40.999564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.000425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:41.001161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.146477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:41.154561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f47bb6ba-14da-4df0-ac63-032728f6753a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.169005 Aug 02 10:37:41.155156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1211/2140] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:40 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:41.178718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:41.179404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:41.185968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:41.186425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.187268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:41.187712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.329719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:41.338742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9f92fde2-5902-4ff3-adb7-f9c322f108f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.164420 Aug 02 10:37:41.339369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1212/2141] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:41 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:41.344127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:41.344767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:41.351738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:41.352194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.352979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:41.353419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:41.443378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:41.452340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1bf68d84-2f5d-4b09-9693-406c292dae59 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.111897 Aug 02 10:37:41.452929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1213/2142] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:41 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:42.179457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:42.180183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:42.187600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.188041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.188812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.189247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.335635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:42.343741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e1731cf2-54cc-4251-bb4a-07a24c7a7e61 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.170790 Aug 02 10:37:42.344340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1214/2143] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:42 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:42.368663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:42.369276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:42.375630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.376337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.377146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.377576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.524728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:42.534443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fb1b9de2-d4fb-454b-b00e-18e925a40d78 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.169103 Aug 02 10:37:42.534443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1215/2144] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:42 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:42.539346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:42.539971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:42.546626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.547133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.547950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:42.548382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:42.621046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:42.629839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3b5d3940-3ca2-4014-8d11-da4ea56a141b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.094304 Aug 02 10:37:42.630417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1216/2145] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:42 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:43.365732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:43.366523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:43.373571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.374014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.374789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.375260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.526769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:43.535614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82ccbda4-19ec-466c-89b1-17297e104ea1 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.173934 Aug 02 10:37:43.536203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1217/2146] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:43 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:43.558161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:43.558769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:43.567372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.567943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.568877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.569298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.718698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:43.727901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4b243151-5d5b-44ab-9b1a-c6a1a755c1b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.173593 Aug 02 10:37:43.728573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1218/2147] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:43 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:43.733782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:43.734585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:43.742218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.742749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.743958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:43.744287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:43.818681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:43.827737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4364b340-3c4d-465a-a42a-7dd8bac9f744 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.097847 Aug 02 10:37:43.828240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1219/2148] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:43 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:44.557713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:44.558441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:44.565280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.565724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:44.566498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.566955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:44.716731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:44.726287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8716e48d-c54d-4859-abf8-e486e9675078 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.172556 Aug 02 10:37:44.726765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1220/2149] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:44 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:44.750714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:44.751856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:44.758908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.759393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:44.760186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.760615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:44.765323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:44.915587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:44.925041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f8d2e6f9-7af3-4912-9ba9-4c0b36cb0627 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.178718 Aug 02 10:37:44.926106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1221/2150] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:44 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:44.933169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:44.934160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:44.947345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.957803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:44.957803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:44.957803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:45.032149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:45.047705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d0efef33-e538-4035-957a-4ed90adc140f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.119987 Aug 02 10:37:45.048770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1222/2151] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:44 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:45.748540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:45.749582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:45.757335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:45.757778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:45.758557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:45.758986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:45.905212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:45.915035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-34ec02ab-2208-47b4-a9b6-630c2209c90a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.170714 Aug 02 10:37:45.915671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1223/2152] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:45 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:45.960935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:45.961557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:45.968184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:45.968626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:45.969432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:45.969839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:46.143759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:46.152868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fd93ded7-2810-4312-9cc3-9380fdba8577 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.195724 Aug 02 10:37:46.153723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1224/2153] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:45 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:46.159768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:46.160632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:46.168419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:46.169018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:46.169932 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:46.170465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:46.243168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:46.253075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-675364b2-9128-4c9b-9b23-ee6469af0304 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.098077 Aug 02 10:37:46.253676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1225/2154] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:46 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:46.941747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:46.942916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:46.954791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:46.955885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:46.957072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:46.957931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:47.127234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:47.136463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e86f1b24-87ce-4159-8b68-737a7010646b tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.201650 Aug 02 10:37:47.137063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1226/2155] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:46 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:47.176537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:47.177441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:47.183971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:47.184558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:47.185409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:47.185903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:47.334356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:47.342911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d4d48f8-f4d8-40f7-9140-c2c32195532e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.170811 Aug 02 10:37:47.343545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1227/2156] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:47 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:47.348279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:47.348892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:47.355418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:47.355877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:47.356668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:47.357095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:47.427902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:47.436649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fc479695-917a-47e7-8b16-0bc81b30c3c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.092024 Aug 02 10:37:47.437252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1228/2157] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:47 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:48.157978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:48.159254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:48.166425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.166877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.167707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.168152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.313957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:48.322985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5ce1921f-5f36-4586-b6fd-d40d5fb98180 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.169067 Aug 02 10:37:48.323632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1229/2158] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:48 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:48.366948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:48.367610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:48.374356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.374809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.375641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.376339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.523239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:48.532119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1762b0f3-fb2d-4e2d-881f-fd322857d464 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.169836 Aug 02 10:37:48.533033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1230/2159] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:48 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:48.547338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:48.548399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:48.559224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.559989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.561370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:48.562135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:48.657775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:48.667115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-481b5be2-4c58-4e6a-a038-5f0517d1bb56 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.126700 Aug 02 10:37:48.667792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1231/2160] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:48 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:49.345600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:49.346444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:49.354076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.354523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.355352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.355795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.507820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:49.517681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3772664d-0645-46aa-89cb-8bca62be2110 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.175983 Aug 02 10:37:49.518357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1232/2161] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:49 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:49.560166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:49.560812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:49.568123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.568572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.569356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.569790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.721660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:49.730782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-43919d9e-c7aa-46de-bbe0-2689b3a4ef67 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.174592 Aug 02 10:37:49.731534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1233/2162] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:49 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:49.736920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:49.737739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:49.745007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.745640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.746621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:49.747212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:49.818321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:49.827278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e40cc3c-b99a-4f9e-827a-c170cdb4e834 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.094558 Aug 02 10:37:49.827873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1234/2163] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:49 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:50.545157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:50.545910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:50.550075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:50.554067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.554520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:50.555361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.555803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:50.710880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:50.719093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-16ef1c37-2bba-4fda-9792-09d9f21b9bc6 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.177874 Aug 02 10:37:50.719742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1235/2164] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:50 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:50.755841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:50.756460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:50.762995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.763476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:50.764250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.764689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:50.924047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:50.934501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9ffe8b1e-f980-4e99-8975-2293a5e0bd7a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.183186 Aug 02 10:37:50.935309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1236/2165] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:50 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:50.942651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:50.943491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:50.951292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.951845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:50.952840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:50.953402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:51.050848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:51.054760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:51.060246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9edc96aa-8a51-46b9-96c7-cba661769ce9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.123794 Aug 02 10:37:51.060839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1237/2166] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:50 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:51.754022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:51.755180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:51.768335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:51.769107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:51.770343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:51.771032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:51.951989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:51.967155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-282f3c16-1bfb-4c8b-bfef-4aedeb8e72ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.219869 Aug 02 10:37:51.968144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1238/2167] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:51 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:51.977135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:51.978422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:51.989760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:51.990669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:51.992210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:51.993088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:52.141456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:52.150858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9d059df-9f6d-464b-925b-6b33bd3d51e5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.181123 Aug 02 10:37:52.151511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1239/2168] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:51 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:52.156369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:52.156993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:52.164137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:52.164593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:52.165399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:52.165843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:52.237293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:52.246275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1d27b905-9a26-4657-9aaa-d6e7e9ca710d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.093649 Aug 02 10:37:52.246882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1240/2169] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:52 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:53.002722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:53.003515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:53.010726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.011173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.012012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.012462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.163539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:53.173212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2eba6398-2a37-4ae0-948f-e916fd387eba tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.174791 Aug 02 10:37:53.173806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1241/2170] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:52 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:53.178779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:53.179441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:53.186602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.187144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.188009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.188449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.347371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:53.361569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cf7398fd-7bee-4914-8822-c4099393070e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.186601 Aug 02 10:37:53.362167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1242/2171] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:53 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:53.367032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:53.367763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:53.375371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.376068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.376865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:53.377806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:53.448464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:53.458136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aae4a7f8-9b46-4108-bce4-f734d303bd28 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.094877 Aug 02 10:37:53.458778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1243/2172] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:53 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:54.197984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:54.198748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:54.206227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.206667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.207477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.207911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.356231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:54.364342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8f2c8c57-01d3-470d-879d-f94ebc681c9d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.170319 Aug 02 10:37:54.364969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1244/2173] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:54 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:54.386131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:54.386853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:54.393917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.394407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.395164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.395655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.542166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:54.551505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6134a34f-4131-458e-9737-190ba7946de8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.169129 Aug 02 10:37:54.552092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1245/2174] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:54 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:54.556906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:54.557517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:54.564496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.565470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.566278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:54.566710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:54.637211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:54.646692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a331f4fa-b5cc-4be0-80a8-60201e6b3405 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.093517 Aug 02 10:37:54.647402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1246/2175] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:54 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:55.388260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:55.389307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:55.397485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.397940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.398722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.399158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.551931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:55.560506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0e70936c-cd47-42e9-ad39-07f32daf5870 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.176124 Aug 02 10:37:55.561078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1247/2176] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:55 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:55.586118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:55.586636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:55.593409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.593853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.594636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.595070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.738062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:55.746632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1cdc298c-e599-40e7-aa0d-f6f34f093c51 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.164661 Aug 02 10:37:55.747241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1248/2177] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:55 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:55.753019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:55.753999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:55.762198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.762662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.763495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:55.763930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:55.836826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:55.846080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-44c157f2-9397-425e-b83a-a5546f35be2f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.097771 Aug 02 10:37:55.846662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1249/2178] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:55 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:56.584066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:56.584919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:56.592448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.592963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:56.593763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.594192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:56.749220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:56.758705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-320d4aaf-c6bb-4545-a311-2d787481659f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.179202 Aug 02 10:37:56.759363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1250/2179] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:56 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:56.776781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:56.777913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:56.789025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.789720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:56.791119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.791902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:56.943061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:56.952412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b963ecbd-d171-4cfe-9681-6f9f3e7e92b7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.182578 Aug 02 10:37:56.953826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1251/2180] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:56 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:56.960610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:56.961699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:56.981190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.981974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:56.982820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:56.983384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:57.053220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:57.062067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7486846f-a24f-4bd2-9e9b-7bf71f642e52 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.107285 Aug 02 10:37:57.062725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1252/2181] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:56 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:57.782843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:57.783733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:57.790740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:57.791214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:57.792009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:57.792451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:57.942727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:57.951925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2b516c15-15b1-49a8-ae18-33a9bc4fecc3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.173223 Aug 02 10:37:57.952525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1253/2182] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:57 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:57.985949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:57.986680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:57.993881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:57.994385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:57.995272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:57.995800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:58.017284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:37:58.179548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:58.188166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9fda8c37-6afc-4dff-883e-3105eaff9f6a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.206863 Aug 02 10:37:58.188803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1254/2183] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:57 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:58.194196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:58.194821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:58.202162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:58.202617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:58.203483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:58.204343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:58.299545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:58.308507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-33b2036f-a9f4-47f3-bbb4-285d78b3a3af tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.118274 Aug 02 10:37:58.309413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1255/2184] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:58 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:37:58.983291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:58.984003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:58.992129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:58.992574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:58.993363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:58.993797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:59.147334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:59.156396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0fce700b-dfed-48db-8e1e-56979efe0d7e tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.177621 Aug 02 10:37:59.156986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1256/2185] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:58 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:59.213784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:59.214719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:59.221917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:59.222374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:59.223157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:59.223676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:59.377630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:59.386476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e172e961-2903-4cfa-a174-433a656f2584 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.177902 Aug 02 10:37:59.387157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1257/2186] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:59 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:37:59.396567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:37:59.397718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:37:59.408865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:59.409729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:59.411128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:37:59.411961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:37:59.480620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:37:59.489176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ec79eb3f-2af6-4ad2-ae74-268322bb6f10 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.100537 Aug 02 10:37:59.489770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1258/2187] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:37:59 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:00.178924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:00.179781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:00.187086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.187570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.188363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.188795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.337581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:00.352722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-77bfd0fe-91af-4487-a977-9b7e9e5639d5 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.177411 Aug 02 10:38:00.353806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1259/2188] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:00 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:00.422003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:00.422688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:00.430228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.430585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.431419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.431863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.577785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:00.587458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b30e6f0-d405-4361-bc41-d320eb4eea07 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.169268 Aug 02 10:38:00.588192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1260/2189] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:00 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:00.597221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:00.598365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:00.609618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.610451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.612397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:00.613162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:00.684978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:00.694357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-665a22a5-32b3-41a3-83b5-02b624d1c409 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.104680 Aug 02 10:38:00.695045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1261/2190] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:00 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:01.390346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:01.391150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:01.398463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.398912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.399721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.400152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.549293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:01.562504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf2d3f7d-8635-4a72-808b-9b5f0cb4abac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.175747 Aug 02 10:38:01.563593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1262/2191] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:01 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:01.628643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:01.629680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:01.640758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.641731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.643398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.644178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.814382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:01.823095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2eba1f0-6b46-49c7-a73e-814d285dc2f4 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.203200 Aug 02 10:38:01.823851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1263/2192] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:01 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:01.828970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:01.829604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:01.836192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.836644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.837456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:01.837896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:01.909833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:01.918626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30eb347c-ef85-48f5-9ba8-db1ff5f1c5d9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.093562 Aug 02 10:38:01.919215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1264/2193] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:01 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:02.126076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:02.126393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:38:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:38:02.585889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:02.586696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:02.594071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:02.594513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:02.595335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:02.596274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:02.742220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:02.750460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d1312a11-094f-4f6d-8ba0-c8318e579bf9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.168381 Aug 02 10:38:02.751444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1265/2194] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:02 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:02.849834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:02.850388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:02.856983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:02.857435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:02.858222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:02.858658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:02.862380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:02.863245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:38:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:38:03.034336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:03.050376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-28f1b783-3ec3-4ba9-a6ae-49ae112df1aa tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.204083 Aug 02 10:38:03.051531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1266/2195] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:02 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:03.060219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:03.061399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:03.072823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:03.073621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:03.075040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:03.075856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:03.170644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:03.185777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4006d83-3723-4274-8244-67ae53e467b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.132681 Aug 02 10:38:03.186377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1267/2196] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:03 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:03.788132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:03.788876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:03.795836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:03.796357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:03.797216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:03.797825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:03.950908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:03.959681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6e1fded3-eca3-4557-b7b7-3ba753f3031f tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.175387 Aug 02 10:38:03.960277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1268/2197] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:03 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:04.073586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:04.074177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:04.081787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.082364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:04.083289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.083799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:04.261043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:04.269779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3bcff436-0b3b-4394-a9e9-29ab063af7b5 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.200270 Aug 02 10:38:04.270361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1269/2198] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:04 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:04.275111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:04.275767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:04.282853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.283388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:04.284194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.284629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:04.357716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:04.366907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b0ba3ea5-bbb9-46af-bfd8-d48a7a4794d5 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.095455 Aug 02 10:38:04.367629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1270/2199] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:04 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:04.982174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:04.983276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:04.995385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.996046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:04.996918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:04.997396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:05.003074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:38:05.149889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:05.159119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7bdf8a7f-5fa9-4409-903e-16ed2f3bdfb9 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.181090 Aug 02 10:38:05.159923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1271/2200] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:04 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:05.294479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:05.295294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:05.302333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:05.302832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:05.303746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:05.304232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:05.463424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:05.475500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-660b1a59-4348-4c6a-b4e4-6bfbfd290f0a tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.185153 Aug 02 10:38:05.476135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1272/2201] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:05 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:05.483346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:05.484449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:05.495643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:05.496319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:05.497519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:05.498248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:05.573563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:05.583351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06271f34-cf45-4884-a03b-6a32fe2b2283 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.105775 Aug 02 10:38:05.584100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1273/2202] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:05 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:06.182941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:06.183751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:06.191304 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.191859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.192660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.193102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.341694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:06.351535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cac78ced-16f5-42a3-b6d4-5478d4b700f0 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.172639 Aug 02 10:38:06.352165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1274/2203] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:06 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:06.503046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:06.503796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:06.511030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.511672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.512657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.513227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.671955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:06.680889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-62944b2a-ef85-469f-8ca5-b6d55104a1dd tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.184659 Aug 02 10:38:06.681473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1275/2204] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:06 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:06.686323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:06.687023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:06.693942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.697331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.697331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:06.697331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:06.778340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:06.788641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e782ef7d-0f04-4a1e-bd8f-6efa70000ca4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.106073 Aug 02 10:38:06.789241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1276/2205] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:06 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:07.374772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:07.375504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:07.384652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.385199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.386052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.386601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.545580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:07.554464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5e63752a-44ce-4bb7-b5b0-f6b127b28c17 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.184026 Aug 02 10:38:07.555059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1277/2206] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:07 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:07.703119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:07.704013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:07.711056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.711534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.712369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.712810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.866450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:07.876300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-765c41df-b916-418d-9eb7-433e745cbc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.176893 Aug 02 10:38:07.876924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1278/2207] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:07 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:07.882824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:07.883715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:07.891002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.891488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.892807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:07.893275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:07.973835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:07.982997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-795d9240-c94d-4797-a4f3-3e1b5de6d527 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.104958 Aug 02 10:38:07.983798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1279/2208] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:07 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:08.601843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:08.602648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:08.610098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:08.610555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:08.615927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:08.615927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:08.793137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:08.801683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78f9ac5a-f2ef-438f-aee8-21d7627c13df tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.210323 Aug 02 10:38:08.802280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1280/2209] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:08 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:08.908228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:08.909275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:08.918839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:08.919654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:08.921289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:08.922064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:09.134774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:09.144508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c4c7852-3cc5-4e00-b13e-ca34fba88052 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.243704 Aug 02 10:38:09.145209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1281/2210] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:08 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:09.150357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:09.151063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:09.159179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:09.159921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:09.161114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:09.161847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:09.252162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:09.268469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a51a2655-ffcc-4c84-a7ba-7491da565b16 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.121004 Aug 02 10:38:09.269564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1282/2211] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:09 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:09.824344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:09.825092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:09.832597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:09.833042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:09.833836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:09.834265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:09.997442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:10.006441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc916876-7b06-4791-9019-155f6c18806a tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.186351 Aug 02 10:38:10.007249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1283/2212] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:09 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:10.171157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:10.171933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:10.179736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:10.180186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:10.180984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:10.181433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:10.327241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:10.336497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b28e893-5672-4a3f-9fa6-0fc719190ef9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.169331 Aug 02 10:38:10.337098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1284/2213] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:10 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:10.343407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:10.344064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:10.348194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:38:10.352983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:10.353785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:10.361101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:10.361101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:10.431150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:10.440230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80648244-6cce-4004-b50d-f3b58c36a337 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.101999 Aug 02 10:38:10.440897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1285/2214] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:10 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:11.042427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:11.043234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:11.050906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.051391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.052177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.052608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.199255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:11.207895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-007df09b-5eb3-4ba8-8f00-92c9dd51688d tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1449 microversion: 2.1 time: 0.169720 Aug 02 10:38:11.208488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1286/2215] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:11 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:11.359819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:11.360438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:11.367336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.367781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.368563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.369000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.519805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:11.523777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:38:11.529334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e5c4b23a-5ccc-4c6e-901a-97bd6f36f253 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.173663 Aug 02 10:38:11.529916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1287/2216] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:11 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:38:11.540918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:11.540918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:11.541993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.542460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.543291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:11.543738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:11.630574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:38:11.639686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d870737d-4c93-4c94-b075-38b7bd8ff10a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.108626 Aug 02 10:38:11.640293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1288/2217] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:38:11 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:38:12.034944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:12.035281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:38:12.094802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:38:12.096305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:38:12.102628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:12.103156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:12.104546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:38:12.105027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:38:15.858838 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:15.859783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:38:22.100083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=8 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:38:22.132792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=10 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:38:36.901830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:38:46.906915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:39:13.513287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:39:13.679565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:39:13.681566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:39:13.684326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:39:13.685155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:39:13.686457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:39:13.687958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:39:13.689043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) Aug 02 10:39:13.690642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:39:13.693357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6130f8ba-9467-4566-8672-a3d50c6c7eab) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:39:13.693357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4302ce6-62e0-4783-8af5-85df8b981acb tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 120.275939 Aug 02 10:39:13.693357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 930/2218] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:37:13 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 120277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:39:13.693357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:39:13.693996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:39:13.697525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:13.698023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:13.698813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:13.699269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:13.770664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:39:13.785555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd6ddfd8-dbb3-4993-9c35-dc46657532a8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.098756 Aug 02 10:39:13.786269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 931/2219] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:39:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:39:13.917246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:39:13.917863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:39:13.924724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:13.925163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:13.926056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:13.926527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:14.075760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:39:14.085064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0755e6fb-1224-412d-8fda-ad2b93c491a9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.297635 Aug 02 10:39:14.085641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 932/2220] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:39:13 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:39:14.090276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:39:14.090890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:39:14.098076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:14.098546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:14.099368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:14.099797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:14.167047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:39:14.175647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dcf3ecaf-e9e1-4deb-93b5-3ef59d046b1c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.088903 Aug 02 10:39:14.176237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 933/2221] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:39:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:39:14.181030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-5290297c-ff38-48ed-9806-05c6c00b7588 req-e772d8d9-c808-4ae5-9b8f-56c3fbf165a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66280587-b1b9-4573-af14-c7ddfeaa86a6", "name": "network-vif-deleted", "tag": "7f184d46-d3ec-4715-923a-96545d7567e6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:39:14.191996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5290297c-ff38-48ed-9806-05c6c00b7588 req-e772d8d9-c808-4ae5-9b8f-56c3fbf165a3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:14.192426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5290297c-ff38-48ed-9806-05c6c00b7588 req-e772d8d9-c808-4ae5-9b8f-56c3fbf165a3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:14.205618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-5290297c-ff38-48ed-9806-05c6c00b7588 req-e772d8d9-c808-4ae5-9b8f-56c3fbf165a3 service nova] Creating event network-vif-deleted:7f184d46-d3ec-4715-923a-96545d7567e6 for instance 66280587-b1b9-4573-af14-c7ddfeaa86a6 on hv-cinder-84753 Aug 02 10:39:14.212886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-5290297c-ff38-48ed-9806-05c6c00b7588 req-e772d8d9-c808-4ae5-9b8f-56c3fbf165a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035210 Aug 02 10:39:14.213638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 934/2222] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:39:14.220746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:39:14.221345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:39:14.228260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:14.228733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:14.229496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:39:14.229925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:39:23.521241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:39:24.225512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:39:24.250606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=24 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:39:35.929514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:39:35.930583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:39:59.434029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:39:59.435433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:41:13.898786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:41:13.903722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:41:13.906522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:41:13.908356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:41:13.910739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:41:13.913701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:41:13.916094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) Aug 02 10:41:13.918637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:41:13.921219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-10319d58-1156-4bec-8634-f4fcb904a74b) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:41:13.921219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-81361766-8580-4161-b1dc-0ebd8da9f2e8 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 181.953995 Aug 02 10:41:13.921219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1289/2223] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:38:11 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 181957 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:41:13.983460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:41:14.097709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:41:14.098333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:41:14.107231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.107689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.108516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.108960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.190818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:41:14.205222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ffdde1d2-28ca-4e6f-a613-bbe0cfb6bfa8 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.295589 Aug 02 10:41:14.206072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1290/2224] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:41:13 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:41:14.216214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:41:14.217133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:41:14.228324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.228986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.230475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.231251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.396940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:41:14.406557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b647b91a-494b-486b-b3a3-07dafaf79fda tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.198787 Aug 02 10:41:14.407463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1291/2225] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:41:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:41:14.413646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:41:14.413646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:41:14.420260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.420710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.421512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.421944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.507696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:41:14.518222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-14a47a51-8dac-4173-92a4-a3257a62d6c4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.109718 Aug 02 10:41:14.518977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1292/2226] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:41:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:41:14.523995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:41:14.524635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:41:14.532052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.532504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.533299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.534233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.565214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:41:14.934495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9e9884bf-e601-4bf8-9d1d-f81133ab6f10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.413943 Aug 02 10:41:14.935493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1293/2227] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:41:14 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:41:14.940777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:41:14.941379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:41:14.948774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.949566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:14.950897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:41:14.951669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:41:22.137517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:41:22.138265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:41:22.873656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:41:22.874209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:41:23.991444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:41:24.945396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:41:24.974478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:41:32.045299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:41:32.046112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:41:35.869784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:41:35.870564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:41:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:42:55.941385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:42:55.942227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:43:14.432004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:43:14.435536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:43:14.438585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:43:14.440146 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:43:14.442956 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:43:14.449134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:43:14.451861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) Aug 02 10:43:14.454891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:43:14.457915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4cc4e005-9b54-4d56-90af-2a5897480a3b) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:43:14.457915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-82e7eb18-c744-4162-9a7a-a4c58f7eb052 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 240.222074 Aug 02 10:43:14.457915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 935/2228] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:39:14 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 269 bytes in 240225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:43:14.457915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:43:14.459140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:43:14.461688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.462259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.463464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.464004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.502771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:43:14.557458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:43:14.570945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c689d227-75e6-42ad-a3b1-6164cf8b74c3 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.129869 Aug 02 10:43:14.571934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 936/2229] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:43:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:43:14.579531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:43:14.580474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:43:14.587954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.592308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.592308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.592308 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.753376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:43:14.762261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2eb4e225-29d2-4473-8733-0dd6207115fe tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.188763 Aug 02 10:43:14.762940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 937/2230] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:43:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:43:14.845310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:43:14.846441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:43:14.858505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.859315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.860667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.861434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.938885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:43:14.951517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-096f3fb0-24ee-4736-a2d4-00586f4f7ccd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.187236 Aug 02 10:43:14.952299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 938/2231] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:43:14 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:43:14.958633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:43:14.959136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:43:14.966090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.970843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.970843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:14.970843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:14.997380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:43:15.147312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.compute.api [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:43:15.148028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fbade81a-5b30-4027-b68c-bf0bf8f5bd63 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.194511 Aug 02 10:43:15.148619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 939/2232] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:43:14 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:43:15.153650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:43:15.154153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:43:15.161215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:15.161666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:15.162450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:43:15.162881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:43:24.525984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:43:25.158608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:43:25.185490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:44:42.147443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:44:42.148293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:44:42.882530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:44:42.883116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:44:52.055087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:44:52.055765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:44:55.879967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:44:55.880631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:45:14.717773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:45:14.722308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:45:14.724882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:45:14.726095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:45:14.728238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:45:14.730705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:45:14.735131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) Aug 02 10:45:14.737995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98fece94-b49f-40ff-bac3-aa77f922ef1e) {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 239.788913 Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:45:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:45:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (10.222.0.49) Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: CRITICAL nova [None req-3c49f608-6a3a-483f-b021-9bd64c643ca5 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Unhandled error: OSError: write error Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova OSError: write error Aug 02 10:45:14.740650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova Aug 02 10:45:14.741845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1294/2233] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:41:14 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 0 bytes in 239792 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 10:45:14.741845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:14.741845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:14.751087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:14.751936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:14.753284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:14.754805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:14.787604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'services' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:45:14.850710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:14.866830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-31854fe0-fb0d-4b04-bd47-7d983e322894 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.137265 Aug 02 10:45:14.867892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1295/2234] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:14 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:14.957132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:14.958965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:14.970370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:14.971442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:14.972552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:14.973155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.128358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:15.140050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb7192af-3feb-4854-9ee4-78f3813cb79e tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.270717 Aug 02 10:45:15.140640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1296/2235] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:14 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:15.145521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:15.146140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:15.152710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.153155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.153937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.154383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.228031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:15.237365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8801f3c0-e844-4051-a6a4-430e0ba43b63 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.095644 Aug 02 10:45:15.237953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1297/2236] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:15 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:15.243253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:15.243763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:15.250467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.250914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.251736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.252168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.282222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:15.472170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:45:15.473498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-73e93218-0f72-42e0-921b-ca0363d8f4ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.233563 Aug 02 10:45:15.474099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1298/2237] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:45:15 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:45:15.478854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:15.479381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:15.485816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.486255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.487024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.487566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.519054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:15.937757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cf356d68-d279-4add-859d-373b1778e820 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 204 len: 0 microversion: 2.1 time: 0.462403 Aug 02 10:45:15.938544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1299/2238] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:45:15 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:45:15.943836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:15.944531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:15.951499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.951870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:15.952694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:15.953124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.025317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:16.033555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-169c0a51-60b1-42e5-9415-146ca9a4fbcc tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.093811 Aug 02 10:45:16.037260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1300/2239] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:15 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:16.040119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.040734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.047319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.047762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.048702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.049093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.224421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:16.234593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-56a29896-d9cc-497a-b306-e6431494fc7c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.199220 Aug 02 10:45:16.235383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1301/2240] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:16 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:16.241071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.241690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.248250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.248686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.249616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.250057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.320936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:16.329916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3ac6401-b76b-4d07-b204-e46743839cd8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.093351 Aug 02 10:45:16.330761 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1302/2241] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:16 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:16.335631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.336119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.342387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.342827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.343642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.344072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.371970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:16.584951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:45:16.586494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d0414bbc-e7d8-4323-b894-a03c4ccf51f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.254368 Aug 02 10:45:16.587538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1303/2242] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:45:16 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:45:16.596303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.597079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.604492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.614428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.614428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.614428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.633513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:16.758907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Instance is already in deleting state, ignoring this request Aug 02 10:45:16.759833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-545e5d95-f5a1-4e77-b4fa-71b17eb3fa7d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 204 len: 0 microversion: 2.1 time: 0.170948 Aug 02 10:45:16.760881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1304/2243] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:45:16 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:45:16.765927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.766562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.774043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.774488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.777366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.777366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.847375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:16.852207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:16.857453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3a15736-063a-464b-b185-793427a3a3ac tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.095846 Aug 02 10:45:16.858040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1305/2244] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:16 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:16.862787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:16.863438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:16.869862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.870309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:16.871079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:16.871548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.017518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:17.026465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-36437de7-27ea-45cd-9c25-0cec013c4f26 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.167359 Aug 02 10:45:17.027102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1306/2245] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:16 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:17.031680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.033117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.038630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.039274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.040064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.040504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.106664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:17.115286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cb05deb-aed7-46c2-ae68-ea409ce5b21c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.087064 Aug 02 10:45:17.115878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1307/2246] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:17.120574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.121070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.128497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.129902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.130750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.131349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.159678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:17.338141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:45:17.339736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c62d2a88-f39d-4ebf-93d1-8167a0f158db tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.222583 Aug 02 10:45:17.340799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1308/2247] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:45:17 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:45:17.350421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.351034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.361491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.362190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.363612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.364374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.399688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:17.454548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Instance is already in deleting state, ignoring this request Aug 02 10:45:17.455504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c38002a-f48e-447f-bed8-6c0bf71c170b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 204 len: 0 microversion: 2.1 time: 0.113113 Aug 02 10:45:17.456146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1309/2248] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:45:17 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:45:17.461925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.462610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.469292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.469873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.470840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.471442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.543534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:17.552093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cfec1d9d-8112-4bb0-896a-d428e71d4b39 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.094636 Aug 02 10:45:17.552884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1310/2249] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:17 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:17.557970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.558624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.588696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.588696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.588696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.588696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.709812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:17.719319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e2286bcb-317b-4f87-8d53-dd18e6b2265c tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.165123 Aug 02 10:45:17.719920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1311/2250] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:17 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:17.724616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.725223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.732117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.732590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.733485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.733959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.808166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:17.818039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c9009226-829f-4a48-96d7-d67a8bbdc667 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.097044 Aug 02 10:45:17.818636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1312/2251] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:17 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:17.823585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.824084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:17.831142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.831692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.834704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:17.834704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:17.862225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:17.992580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:45:17.993332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0da58eac-6c35-4019-93c6-35156af7c6c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.173579 Aug 02 10:45:17.993926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1313/2252] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:45:17 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:45:17.998674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:17.999177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.006387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.006841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.007642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.008074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.033913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:18.243237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Instance is already in deleting state, ignoring this request Aug 02 10:45:18.243984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-55b20e86-8a29-40fa-bd66-813f4ce26859 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 204 len: 0 microversion: 2.1 time: 0.249070 Aug 02 10:45:18.244583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1314/2253] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:45:17 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:45:18.249724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:18.250342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] [instance: 66280587-b1b9-4573-af14-c7ddfeaa86a6] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.273271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.273271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.273271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.273271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.330192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d42f70ad3cb4c9388c09a70cfc950dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f73de1986f406182cc6a52b8376b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:18.339285 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aabf2b40-711e-453a-9096-0b5e79912b53 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6" status: 200 len: 1214 microversion: 2.1 time: 0.093476 Aug 02 10:45:18.339895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1315/2254] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:18 2022] GET /compute/v2.1/servers/66280587-b1b9-4573-af14-c7ddfeaa86a6 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:18.344645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:18.345441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: f10a2ee2-07a5-43d7-b3f5-8f382de25a9b] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.351970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.352403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.353196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.353638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.502532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:18.511490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6826cdc2-71b4-4c79-a6d2-2288227d37cc tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b" status: 200 len: 1734 microversion: 2.1 time: 0.170464 Aug 02 10:45:18.527045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1316/2255] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:18 2022] GET /compute/v2.1/servers/f10a2ee2-07a5-43d7-b3f5-8f382de25a9b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:18.527045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:18.527045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.527045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.527731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.527958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.528397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.533159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:18.601270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:18.609521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4d1e570f-dc6c-41ca-bb25-f5408e81fa20 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 200 len: 1372 microversion: 2.1 time: 0.095662 Aug 02 10:45:18.610111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1317/2256] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:18 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:18.615825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:18.616329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.625612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.632564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.632564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.632564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.670907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:18.895072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Instance is already in deleting state, ignoring this request Aug 02 10:45:18.897769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bba7c77a-974c-4b8a-9e7c-a4aae63def52 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 204 len: 0 microversion: 2.20 time: 0.284809 Aug 02 10:45:18.897769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1318/2257] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:45:18 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:45:18.902478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:18.903088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:18.910357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.910808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.911637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:18.912074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:18.940028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:45:19.089274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.compute.api [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Instance is already in deleting state, ignoring this request Aug 02 10:45:19.090123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3b6628fc-389d-43f7-a043-788695e16524 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 204 len: 0 microversion: 2.1 time: 0.192679 Aug 02 10:45:19.091010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1319/2258] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:45:18 2022] DELETE /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:45:19.095861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f530feba-9c3f-44f9-857a-72fa9f371ee8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '.version_select at 0x7f70c2a91af0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:19.220910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f530feba-9c3f-44f9-857a-72fa9f371ee8 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-813696852" status: 202 len: 0 microversion: 2.1 time: 0.129013 Aug 02 10:45:19.221674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1320/2259] 10.222.0.49 () {58 vars in 1218 bytes} [Tue Aug 2 10:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-813696852 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:45:19.230675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99b5a760-d5ad-4788-b09d-0195d50b9345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '.version_select at 0x7f70cb4389d0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:19.338974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99b5a760-d5ad-4788-b09d-0195d50b9345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390253294" status: 202 len: 0 microversion: 2.1 time: 0.116105 Aug 02 10:45:19.340469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1321/2260] 10.222.0.49 () {58 vars in 1218 bytes} [Tue Aug 2 10:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390253294 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:45:19.349116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-67daf95f-50d9-40e4-a716-de320f95a663 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] Calling method '.version_select at 0x7f70c2a9fe50>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:19.448625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-67daf95f-50d9-40e4-a716-de320f95a663 tempest-TestShelveInstance-1176135619 tempest-TestShelveInstance-1176135619-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2073184305" status: 202 len: 0 microversion: 2.1 time: 0.103173 Aug 02 10:45:19.456726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1322/2261] 10.222.0.49 () {58 vars in 1254 bytes} [Tue Aug 2 10:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2073184305 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:45:19.456726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:19.456726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:19.463491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:19.463872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:19.465678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:19.465678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:19.706026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:19.722195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:19.725863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:19.728565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6917a2ef-c49c-4876-b2da-e57de988c8a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.276794 Aug 02 10:45:19.729655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1323/2262] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:19.744004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:19.747681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:19.765259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:19.768239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:19.768725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:19.770345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:20.004853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:20.013876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dbd6bc11-4673-4dfe-b9d0-886cd0a36581 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.282695 Aug 02 10:45:20.014473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1324/2263] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:20.769438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:20.771216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:20.779921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:20.780265 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:20.781245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:20.781707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:20.971175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:20.983360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:20.985886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:20.987627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0749ab2d-3506-4798-88bf-42a51b0d320d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.222856 Aug 02 10:45:20.989096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1325/2264] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:21.038882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:21.038882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:21.046957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:21.047517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:21.048573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:21.049044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:21.231548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:21.246203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c8d82c39-2c73-42b7-90d8-3687fce6a607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.212235 Aug 02 10:45:21.246838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1326/2265] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:21.603981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-47b4ff85-8bc5-476d-90b9-31d411337971 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: .version_select at 0x7f70c36568b0>, body: {"keypair": {"name": "tempest-keypair-1517048560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOra6I+RM9emm0Xj6N7PapXeEAyasd45PApkXxwd+DKyEAnDtJDDced3YUPhQN7aIQFj06UEhd1D3ixd/Mc18AWgemj8LCIwXdqzQtz1IQcytSQsKUUr22P4RPeEKoiKvQ=="}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:21.639919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-47b4ff85-8bc5-476d-90b9-31d411337971 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:45:21.648416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-47b4ff85-8bc5-476d-90b9-31d411337971 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:45:21.791750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-47b4ff85-8bc5-476d-90b9-31d411337971 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196563 Aug 02 10:45:21.795256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1327/2266] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:45:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:45:21.884469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-52fe3b81-dcd4-4496-a272-097cc826dce1 req-7a2f5621-7f0b-44cb-9a18-037a30d1131b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10a2ee2-07a5-43d7-b3f5-8f382de25a9b", "tag": "7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:21.905831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-52fe3b81-dcd4-4496-a272-097cc826dce1 req-7a2f5621-7f0b-44cb-9a18-037a30d1131b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:21.906946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-52fe3b81-dcd4-4496-a272-097cc826dce1 req-7a2f5621-7f0b-44cb-9a18-037a30d1131b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:21.933251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-52fe3b81-dcd4-4496-a272-097cc826dce1 req-7a2f5621-7f0b-44cb-9a18-037a30d1131b service nova] Creating event network-changed:7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8 for instance f10a2ee2-07a5-43d7-b3f5-8f382de25a9b on hv-cinder-84753 Aug 02 10:45:21.946380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-52fe3b81-dcd4-4496-a272-097cc826dce1 req-7a2f5621-7f0b-44cb-9a18-037a30d1131b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150888 Aug 02 10:45:21.949331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1328/2267] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:45:22.022477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:22.023831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:22.036207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:22.036978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:22.038513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:22.039344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:22.265671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:22.281772 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:22.286087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:22.288397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-43fd70ce-8f20-4ce8-b0dd-a84ec7797c05 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.274802 Aug 02 10:45:22.296472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1329/2268] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:22.299992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:22.300803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:22.316905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:22.317827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:22.319560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:22.320383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:22.653747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:22.664415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-811b0077-d9e9-4e78-8848-f614777100b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.373041 Aug 02 10:45:22.665883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1330/2269] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:23.313889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:23.315774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:23.324793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:23.326201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:23.327424 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:23.328034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:23.657072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:23.674218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:23.679779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:23.681311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e9994642-e7fb-4384-896f-ab8a6781bb71 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.372226 Aug 02 10:45:23.682434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1331/2270] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:23.702123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:23.703733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:23.711718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:23.712351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:23.713379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:23.713951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:23.952610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:23.974279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6d5ab965-a541-40a6-90d0-2b0ad44decf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.276303 Aug 02 10:45:23.977705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1332/2271] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:24.710696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:24.712119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:24.715956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:24.721701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:24.722321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:24.723860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:24.724428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:24.793189 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:25.071102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:25.083626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:25.085321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:25.086639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-645d8f03-0194-465f-81f8-9db365ee567d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.380887 Aug 02 10:45:25.087329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1333/2272] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:25.092809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:25.093160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:25.100297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:25.101011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:25.102063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:25.102676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:25.349108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:25.362715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-631a1c26-e3e8-4a8c-8d4c-bdf7ea686d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.273738 Aug 02 10:45:25.363517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1334/2273] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:25.520646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1940217669", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c49660-b8e9-4548-b1ea-a7c2e86c6f47"}], "security_groups": [{"name": "tempest-securitygroup--658633324"}], "key_name": "tempest-keypair-1517048560", "user_data": "}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:25.693722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] validate_networks() for [('11c49660-b8e9-4548-b1ea-a7c2e86c6f47', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:45:26.299489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:45:26.300061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:45:26.300363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:45:26.301643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:45:26.302763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:45:26.313309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.313765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:26.314575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.315017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:26.334295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:45:26.338999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:45:26.352114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:45:26.354537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:45:26.499674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4cd0b3f0-7549-4b0b-a807-50287d4568c1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.989125 Aug 02 10:45:26.501599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1335/2274] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:45:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:45:26.513295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:26.515702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:26.529087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.529087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:26.530033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.531593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:26.569198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:26.727899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:26.740567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:26.740567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:26.740895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eae1110b-3df5-4aab-ab79-f65f47b8e5eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.237652 Aug 02 10:45:26.751894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1336/2275] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:26.751894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:26.751894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:26.765208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.765716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:26.766698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:26.767145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:27.009586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:27.018502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3fec4fda-22de-430b-9984-50f57bcca396 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.275287 Aug 02 10:45:27.019076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1337/2276] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:27.032924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bcfa0760-ac74-4835-b97f-74be536bb46b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:27.032924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bcfa0760-ac74-4835-b97f-74be536bb46b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:27.130923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bcfa0760-ac74-4835-b97f-74be536bb46b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:27.151805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bcfa0760-ac74-4835-b97f-74be536bb46b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1242 microversion: 2.1 time: 0.130159 Aug 02 10:45:27.152767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1338/2277] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:27 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:27.771346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:27.772264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:27.785105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:27.788229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:27.791471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:27.791471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:28.045366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:28.088029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:28.092706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:28.094681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11310f06-80e2-43d9-bf46-ff991fa85884 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.328077 Aug 02 10:45:28.109115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1339/2278] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:28.118312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:28.119434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:28.134145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:28.135948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:28.137318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:28.138232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:28.417481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:28.433222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0feb2aca-db46-4977-9895-548e1a753565 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.322493 Aug 02 10:45:28.447282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1340/2279] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:28.447282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:28.447282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:28.457737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:28.458527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:28.460017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:28.460813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:28.763146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:28.771749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-168f645a-53a1-41bf-9c59-9a4ebe81e848 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1238 microversion: 2.1 time: 0.335734 Aug 02 10:45:28.773053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1341/2280] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:28 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1238 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:29.137261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:29.138195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:29.157309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.158040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.159487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.160540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.354317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:29.364132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:29.365725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:29.366972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8284426-ae0c-48c3-ab3a-64db47336852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.234828 Aug 02 10:45:29.367576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1342/2281] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:29.461690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:29.462558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:29.473284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.474091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.477071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.477980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.762135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:29.781610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e88a91a9-c024-45bd-be4d-1bbb26e7da84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.322279 Aug 02 10:45:29.781610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1343/2282] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:29.798021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:29.799091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:29.806991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.807641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.808694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:29.809546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:29.916387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:29.940167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eee023e9-b632-497a-ae91-7ce9c5c8fc4b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1294 microversion: 2.1 time: 0.147149 Aug 02 10:45:29.942221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1344/2283] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:29 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1294 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:30.397062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:30.398176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:30.409624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:30.410882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:30.412308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:30.413129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:30.697426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:30.709411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:30.712061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:30.713790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c2e1d471-134b-4be7-9eac-50c29973a529 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.326051 Aug 02 10:45:30.714633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1345/2284] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:30.800283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:30.801348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:30.808775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:30.809585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:30.810593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:30.811514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:31.015008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:31.024063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbf055e2-11c9-4ef8-a027-81b135ff551d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.227921 Aug 02 10:45:31.024652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1346/2285] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:31.029313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:31.029928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:31.037518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:31.038292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:31.039349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:31.040018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:31.243764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:31.253477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e0a3e03b-134c-49c1-a985-de4964e3fd0a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.227547 Aug 02 10:45:31.255074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1347/2286] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:31 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:31.750243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:31.751548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:31.763617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:31.764281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:31.765199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:31.765741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:31.955612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:31.973394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:31.976672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:31.978993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b52ff5f-6185-4770-b371-daab54981699 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.236603 Aug 02 10:45:31.980030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1348/2287] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:32.046296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:32.046958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:32.053743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:32.054268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:32.055134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:32.055606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:32.214799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:32.223404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2aeac368-cfdc-4e42-b5a9-742b32b804e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.181231 Aug 02 10:45:32.224204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1349/2288] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:32.289768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:32.290483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:32.296926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:32.301155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:32.301155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:32.301155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:32.463496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:32.472217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1a46e281-b2ee-4372-b023-04e1d2271ee8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.186236 Aug 02 10:45:32.473808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1350/2289] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:32 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:32.759740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-1b55c181-7c95-4b30-ab90-f7b2380fd65c req-f9e350cc-9241-4f22-8569-064440db3185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015594f3-0995-434f-b0b2-e79e4f7a8a77", "tag": "46a2ac61-dd78-4ec2-a498-bcc8fe863efd"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:32.773191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-1b55c181-7c95-4b30-ab90-f7b2380fd65c req-f9e350cc-9241-4f22-8569-064440db3185 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:32.773648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-1b55c181-7c95-4b30-ab90-f7b2380fd65c req-f9e350cc-9241-4f22-8569-064440db3185 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:32.786047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-1b55c181-7c95-4b30-ab90-f7b2380fd65c req-f9e350cc-9241-4f22-8569-064440db3185 service nova] Creating event network-changed:46a2ac61-dd78-4ec2-a498-bcc8fe863efd for instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 on hv-cinder-84753 Aug 02 10:45:32.791796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-1b55c181-7c95-4b30-ab90-f7b2380fd65c req-f9e350cc-9241-4f22-8569-064440db3185 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036443 Aug 02 10:45:32.792621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1351/2290] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:45:33.016930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:33.018123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:33.027381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.028150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.029051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.029561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.176025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:33.185567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:33.187289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:33.188504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-39c2a8bf-925f-4970-a82c-2184536111a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177268 Aug 02 10:45:33.189064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1352/2291] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:33.249974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:33.254455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:33.263422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.264443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.266085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.266880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.446802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:33.460478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7efd97f7-97f7-4944-8eea-88d40b637985 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.213734 Aug 02 10:45:33.460478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1353/2292] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:33.496942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:33.497560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:33.504545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.505003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.505775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:33.506510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:33.704277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:33.709129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:33.718197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9e44a6c1-75a7-46fe-8901-21207b46a5a4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.221018 Aug 02 10:45:33.718197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1354/2293] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:33 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:34.216045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:34.217498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:34.231146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.232053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.233378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.234156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.417993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:34.435342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:34.438564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:34.440882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88c7d936-fdb2-457c-b610-9d781012e0ba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.231794 Aug 02 10:45:34.442058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1355/2294] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:34.479250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:34.479886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:34.486576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.487029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.487859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.488904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.640619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:34.650441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8fe54dba-3109-4a63-868e-0b5e52dc247a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.175073 Aug 02 10:45:34.651032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1356/2295] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:34.739355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:34.741115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:34.746566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.747013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.747843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:34.748289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:34.899660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:34.909695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc60c79c-1872-406a-994c-01f2b9b62b15 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.174381 Aug 02 10:45:34.911271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1357/2296] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:34 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:35.466206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:35.466948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:35.474365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.474812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:35.475697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.476140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:35.643374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:35.653326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:35.654975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:35.656263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d7604aff-915b-4e8c-964a-3b12da7d6984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.194049 Aug 02 10:45:35.656825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1358/2297] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:35.672643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:35.673267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:35.680013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.680495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:35.681272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.681706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:35.837759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:35.846624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-df1352c0-5656-421f-8439-8885ad167607 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.178091 Aug 02 10:45:35.847468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1359/2298] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:35.933496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:35.934025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:35.940870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.941812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:35.942598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:35.943027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:36.096623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:36.105568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-74c1a817-14b7-4542-8695-19913506c52f tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.176188 Aug 02 10:45:36.106162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1360/2299] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:35 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:36.680273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:36.681027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:36.682781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:36.688451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:36.688900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:36.689723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:36.690161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:36.843631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:36.853080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:36.854646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:36.855949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2bfe9050-72c1-4ab1-9fdf-9a72fe26c023 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.179672 Aug 02 10:45:36.856537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1361/2300] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:36.882362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:36.882975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:36.889625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:36.891712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:36.891712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:36.891712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:37.041198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:37.050215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b04723c5-3a5c-4dd7-9e82-b567fc9b09e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.172911 Aug 02 10:45:37.051369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1362/2301] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:37.131966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:37.132974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:37.144194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:37.144983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:37.146364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:37.147134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:37.147994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=12 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:37.312729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:37.320782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6ce88838-729d-45e0-a032-559cd133f87a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.197013 Aug 02 10:45:37.321733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1363/2302] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:37 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:37.881219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:37.881998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:37.888825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:37.889271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:37.890052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:37.890486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:38.029615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:38.039157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:38.040792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:38.042006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-07f39038-9a99-4671-a952-66ed3050a962 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.165811 Aug 02 10:45:38.042574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1364/2303] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:38.072788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:38.073405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:38.084268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:38.084268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:38.084268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:38.084268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:38.245869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:38.261738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-117b62a6-1319-4147-ac66-19e5a5b6f798 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.192594 Aug 02 10:45:38.262773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1365/2304] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:38.356044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:38.356689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:38.363572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:38.364057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:38.365292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:38.365292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:38.527219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:38.539732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-88613c0e-e3c7-419c-80ab-6d9234e7b53a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.188875 Aug 02 10:45:38.540449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1366/2305] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:38 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:39.066538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:39.067348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:39.074263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.074706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.075552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.075980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.231737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:39.241722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:39.243364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:39.244621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-558e44b3-ff4e-44f8-a334-b2b4461ec9a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.182309 Aug 02 10:45:39.245210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1367/2306] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:39.299942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:39.301611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:39.309179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.309629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.310500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.310972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.495777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:39.505627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ad769179-c7e8-43bc-ae9a-587c9886c5a1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.209969 Aug 02 10:45:39.506311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1368/2307] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:39.563142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:39.564055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:39.571727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.572864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.573690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:39.574130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:39.731355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:39.740448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e2724777-c2a7-4044-b1e1-167b414461dd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.181265 Aug 02 10:45:39.741112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1369/2308] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:39 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:40.272443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:40.273583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:40.285888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.286726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.288179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.288968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.464539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:40.473767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:40.475339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:40.476543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b165a038-e8bd-43db-a241-a0cc67a1d9c3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.211612 Aug 02 10:45:40.477110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1370/2309] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:40.716512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-c9f637f5-c136-4b67-a72f-e8ff9f5b5936 req-f3e3d790-63e0-4aa9-b16b-cadcdb607b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015594f3-0995-434f-b0b2-e79e4f7a8a77", "name": "network-vif-plugged", "status": "completed", "tag": "46a2ac61-dd78-4ec2-a498-bcc8fe863efd"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:40.725253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-c9f637f5-c136-4b67-a72f-e8ff9f5b5936 req-f3e3d790-63e0-4aa9-b16b-cadcdb607b51 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.725699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-c9f637f5-c136-4b67-a72f-e8ff9f5b5936 req-f3e3d790-63e0-4aa9-b16b-cadcdb607b51 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.738140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-c9f637f5-c136-4b67-a72f-e8ff9f5b5936 req-f3e3d790-63e0-4aa9-b16b-cadcdb607b51 service nova] Creating event network-vif-plugged:46a2ac61-dd78-4ec2-a498-bcc8fe863efd for instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 on hv-cinder-84753 Aug 02 10:45:40.743637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-c9f637f5-c136-4b67-a72f-e8ff9f5b5936 req-f3e3d790-63e0-4aa9-b16b-cadcdb607b51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265137 Aug 02 10:45:40.744255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1371/2310] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:45:40.749685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:40.750390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:40.758085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.758590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.759412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.768047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.768047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:40.914684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:40.923360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d1f30887-4d05-44c5-bdca-b19b176d7fd2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.177839 Aug 02 10:45:40.923940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1372/2311] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:40.928745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:40.929358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:40.935657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.936105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:40.936885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:40.937329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:41.080579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:41.089368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2617f08d-fc64-4c11-adf4-0d881d7301db tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.164349 Aug 02 10:45:41.089957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1373/2312] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:40 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:41.518689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:41.519446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:41.522801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:41.526414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:41.526854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:41.527662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:41.528093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:41.666160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:41.680297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:41.681828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:41.683052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0c68a384-b568-4eca-b052-a8c6d627fcd0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.169162 Aug 02 10:45:41.683655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1374/2313] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:41.945180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:41.945677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:41.952447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:41.952897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:41.953668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:41.954104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:42.123005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:42.130150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6081add6-dd64-4c8f-90e1-7a19134cf218 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.188895 Aug 02 10:45:42.130744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1375/2314] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:42.135681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:42.136317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:42.143322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:42.143775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:42.145070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:42.145515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:42.294765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:42.302865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-441b2fb8-426e-4477-bb72-29f88af3b5fc tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1367 microversion: 2.1 time: 0.170992 Aug 02 10:45:42.303494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1376/2315] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:42 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:42.709396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:42.710197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:42.717410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:42.717866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:42.718695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:42.719133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:42.865576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:42.875419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:42.876963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:42.878194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-00ab1b38-7f1d-4221-8afa-913609afe405 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.173557 Aug 02 10:45:42.879649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1377/2316] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:43.156215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:43.156829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:43.163900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.164345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.165142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.165632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.313571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:43.324047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8f38e639-0253-4d68-aac5-0e3d8f159f53 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.172139 Aug 02 10:45:43.331319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1378/2317] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:43.331319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:43.334623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:43.340680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.341399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.342486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.343033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.594062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:43.602510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e0699752-1d16-467d-8970-ec1dad17288c tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1557 microversion: 2.1 time: 0.276180 Aug 02 10:45:43.603179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1379/2318] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:43 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1557 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:43.623343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:43.623830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:43.630530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.630967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.631833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.632330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.719369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b15eae78-9a2a-4666-9dfd-5a6bcecf3bf1 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099863 Aug 02 10:45:43.719963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1380/2319] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:45:43 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:45:43.904231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:43.905149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:43.919972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.920416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:43.921222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:43.921697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:44.061370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:44.071049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:44.072998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:44.074319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-10bdb1ae-3222-411c-9118-6dcc6dcc4e06 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.175315 Aug 02 10:45:44.075096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1381/2320] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:44.353586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:44.354465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:44.361986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:44.363523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:44.364332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:44.364769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:44.521717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:44.537204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a449dee-f70d-43bc-8ecb-4facae4d890d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.187592 Aug 02 10:45:44.538290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1382/2321] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:44.906223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-2e39fabe-945b-43c4-a560-33b2c2bfa998 req-75a40f10-264c-421e-9ba0-695aeb9ac2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015594f3-0995-434f-b0b2-e79e4f7a8a77", "tag": "46a2ac61-dd78-4ec2-a498-bcc8fe863efd"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:45:44.916855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-2e39fabe-945b-43c4-a560-33b2c2bfa998 req-75a40f10-264c-421e-9ba0-695aeb9ac2dc service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:44.917389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-2e39fabe-945b-43c4-a560-33b2c2bfa998 req-75a40f10-264c-421e-9ba0-695aeb9ac2dc service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:44.932274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-2e39fabe-945b-43c4-a560-33b2c2bfa998 req-75a40f10-264c-421e-9ba0-695aeb9ac2dc service nova] Creating event network-changed:46a2ac61-dd78-4ec2-a498-bcc8fe863efd for instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 on hv-cinder-84753 Aug 02 10:45:44.938131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-2e39fabe-945b-43c4-a560-33b2c2bfa998 req-75a40f10-264c-421e-9ba0-695aeb9ac2dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035776 Aug 02 10:45:44.938955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1383/2322] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:45:45.102100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:45.102841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:45.110433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:45.110896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:45.111738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:45.112179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:45.299358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:45.317010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:45.320457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:45.322960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3fb5ebae-b558-4559-9b6d-c83b017320c6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.225657 Aug 02 10:45:45.324333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1384/2323] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:45.564748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:45.566517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:45.575335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:45.575639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:45.576575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:45.577127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:45.738636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:45.748392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-39e96663-a61f-4b4e-b51e-20c4e1c2d01d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.190406 Aug 02 10:45:45.749247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1385/2324] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:46.361799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:46.362560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:46.369446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:46.369899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:46.370684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:46.371115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:46.537088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:46.554057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:46.557196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:46.559399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6566a9c9-7965-4eb0-a2f1-93f73ed85bd5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.201507 Aug 02 10:45:46.560432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1386/2325] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:46.771003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:46.771665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:46.779686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:46.780143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:46.780966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:46.781411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:46.925243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:46.934112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e92a7e6-e8ef-438e-9a9d-583502e21f11 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167639 Aug 02 10:45:46.934699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1387/2326] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:47.603834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:47.604911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:47.616380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:47.617049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:47.618397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:47.619301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:47.770469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:47.787645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:47.790550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:47.792841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0dfe356a-0850-43a7-82fb-20538b9aef03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.196554 Aug 02 10:45:47.793865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1388/2327] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:47.957555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:47.958333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:47.965369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:47.965947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:47.966821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:47.967425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:48.112318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:48.116014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:48.121372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-11825e93-d355-406b-b060-f9aaaf779e3c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.168221 Aug 02 10:45:48.121975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1389/2328] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:48.836944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:48.837769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:48.849456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:48.849904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:48.850943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:48.851574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:49.002769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:49.013192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:49.014750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:49.015999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-50b4d9f0-1dce-4576-83ed-dd76361db020 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.185834 Aug 02 10:45:49.016565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1390/2329] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:45:49.147907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:49.148430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:49.155016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:49.155481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:49.156243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:49.156678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:49.304701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:49.313214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-99c36c2f-f929-4a2d-b41f-b53187795e63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.169384 Aug 02 10:45:49.313790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1391/2330] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:50.041052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:50.041729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:50.048915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:50.049368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:50.050207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:50.050641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:50.197869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:50.212227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:50.213984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:50.215241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-02989d27-3dd9-4bc5-b2db-11c7c97eec11 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.178871 Aug 02 10:45:50.215819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1392/2331] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:50.338036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:50.338568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:50.345419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:50.345864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:50.346656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:50.347829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:50.522523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:50.535966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-500245ef-c8e5-4698-b390-825422c3b1e7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.201177 Aug 02 10:45:50.536712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1393/2332] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:51.239928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:51.240836 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:51.247851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.248295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.249078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.249503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.392287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:51.401915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:51.403575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:51.404771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fbb24bf8-90cb-40f0-8d06-7a51d34f29c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.168939 Aug 02 10:45:51.405353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1394/2333] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:51.558167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:51.558842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:51.566244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.566654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.567475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.567918 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.743929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:51.752018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f82a27ac-49c8-488d-9943-9e117894afba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.197973 Aug 02 10:45:51.752592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1395/2334] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:52.428810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:52.429498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:52.436377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:52.436824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:52.437604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:52.438030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:52.833406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:52.843999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:52.846049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:52.848037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ad9a2e6d-95d4-4aee-8320-c7ec28d571dd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.423214 Aug 02 10:45:52.848817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1396/2335] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:52.857902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:52.859068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:52.870716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:52.871581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:52.873041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:52.873871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:53.021621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:53.030996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83f15ff0-9ea4-4273-8f1b-2301f0a146e2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.180631 Aug 02 10:45:53.031519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1397/2336] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:53.889411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:53.890116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:53.897395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:53.897842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:53.898662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:53.899107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:54.050246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:54.060689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:54.062662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:54.063978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0912cbd1-edbf-4bd8-8ae0-132f1d528685 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.178824 Aug 02 10:45:54.064591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1398/2337] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:54.069556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:54.070177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:54.077072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:54.077518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:54.078320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:54.078753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:54.238776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:54.248240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6f76f587-4465-4157-b4a2-3fa0a1ae3819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.182541 Aug 02 10:45:54.249395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1399/2338] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:55.090375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:55.091272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:55.098227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:55.098682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:55.099567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:55.100009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:55.249602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:55.259420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:55.260947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:55.262170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-38c4701e-76b6-46e4-8b33-22c6ca274b58 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.175979 Aug 02 10:45:55.262743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1400/2339] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:55.270619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:55.271255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:55.277987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:55.278516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:55.279333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:55.279802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:55.445605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:55.454110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2585a47b-0ffb-404e-8da5-a87286d16463 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.187414 Aug 02 10:45:55.454729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1401/2340] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:56.286791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:56.287532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:56.294738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:56.295239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:56.296069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:56.296524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:56.454950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:56.470653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:56.483246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:56.483246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c33bf4b8-31c6-4567-b0d4-2fc4747231b4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.193143 Aug 02 10:45:56.483246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1402/2341] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:56.485727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:56.486842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:56.498669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:56.499469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:56.500948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:56.501697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:56.671862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:56.680856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc13bc13-a0a0-4618-ab32-d1c0144bb2b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.202211 Aug 02 10:45:56.681443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1403/2342] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:57.501210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:57.501953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:57.509599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:57.510044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:57.510826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:57.511281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:57.681611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:57.692773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:57.694410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:57.696169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-478cad9f-00a9-4a53-8685-60ebfd51989a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.198701 Aug 02 10:45:57.697169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1404/2343] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:57.702714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:57.703364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:57.710718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:57.711165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:57.711976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:57.712408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:57.856543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:57.865794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc9bae25-e5f6-4172-80de-913108e4df49 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166815 Aug 02 10:45:57.866395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1405/2344] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:45:58.721625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:58.723055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:58.730278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:58.730724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:58.731546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:58.731985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:58.753463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:45:58.882196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:58.891380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:58.892991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:58.894823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-48aef890-7348-49de-ba80-61d0607e8467 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177314 Aug 02 10:45:58.895418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1406/2345] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:45:58.900143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:58.900725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:58.907615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:58.908054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:58.908834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:58.909286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:59.049891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:45:59.058428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f9152e0e-0a8a-4f55-8d02-46a6ef5b30cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161961 Aug 02 10:45:59.059027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1407/2346] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:45:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:45:59.921489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:59.922176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:45:59.929728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:59.930175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:59.930974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:59.931455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:00.072990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:00.083601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:00.085121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:00.086312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1bb4c43-c90e-46af-9348-e7788afd7177 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.168927 Aug 02 10:46:00.086886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1408/2347] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:45:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:00.091528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:00.092134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:00.098973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:00.099453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:00.100223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:00.100655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:00.243279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:00.251643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-21a8ca02-cb74-402b-9347-c06743eea9f1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163632 Aug 02 10:46:00.252234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1409/2348] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:01.110875 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:01.111668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:01.118586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:01.120850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:01.120850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:01.120850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:01.269914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:01.279996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:01.281769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:01.283018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-da363841-8c9d-4b92-8e0a-7ff8b7a21657 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.176220 Aug 02 10:46:01.283624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1410/2349] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:01.288470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:01.289128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:01.295855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:01.296294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:01.297071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:01.297500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:01.480271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:01.489601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-98649a13-d8fa-4882-be5f-cde9a2c355ea tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.204880 Aug 02 10:46:01.494062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1411/2350] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:02.307846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:02.308564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:02.315689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:02.316350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:02.317221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:02.317769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:02.495602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:02.505451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:02.507015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:02.508435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3db30183-ba35-4bb1-9ce5-38b6224196c9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.204637 Aug 02 10:46:02.509017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1412/2351] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:02.514019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:02.514633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:02.521844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:02.522287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:02.523064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:02.523557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:02.668497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:02.678114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-197ca859-f7dd-4cd1-9446-10effbb8ffd8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167924 Aug 02 10:46:02.678814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1413/2352] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:03.538364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:03.539144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:03.546927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:03.547451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:03.548289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:03.548806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:03.706905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:03.716444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:03.720153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:03.721629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e44b7889-ea0c-4e6f-b804-ffedc6654ef1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.188154 Aug 02 10:46:03.722260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1414/2353] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:46:03.730188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:03.730943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:03.739079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:03.739635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:03.740471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:03.741074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:03.887121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:03.897314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ae82f06-7b44-44de-86bc-0b4fce6d2d48 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.173902 Aug 02 10:46:03.898010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1415/2354] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:04.755857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:04.756684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:04.763450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:04.763897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:04.764684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:04.765119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:04.909534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:04.921331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:04.923371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:04.924733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-be2e4e90-4d8c-4020-abf6-93b11ba6b2f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.173280 Aug 02 10:46:04.925425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1416/2355] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:04.930506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:04.931117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:04.938104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:04.938550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:04.939377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:04.939814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:05.130889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:05.140255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5bee5a72-5554-437b-a71d-1bf6c68c169f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.213595 Aug 02 10:46:05.140948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1417/2356] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:05.954717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:05.955577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:05.962842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:05.963332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:05.964138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:05.964586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:06.112189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:06.121476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:06.123017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:06.124259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7da26a99-47e0-4f33-aad6-a5eb66fda0c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.174021 Aug 02 10:46:06.124839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1418/2357] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:06.164401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:06.165024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:06.171361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:06.171812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:06.172586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:06.173024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:06.321655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:06.330228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1d7a176d-7a2c-4b53-a6e5-65a662cd6758 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170229 Aug 02 10:46:06.330662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1419/2358] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:07.148105 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:07.148849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:07.155820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:07.156281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:07.157051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:07.157488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:07.322507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:07.331866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:07.333407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:07.334597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-025a3e70-bf1e-4357-80a8-a9ca7125b36b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.190708 Aug 02 10:46:07.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1420/2359] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:07.359467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:07.360456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:07.368198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:07.368813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:07.369814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:07.370560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:07.529012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:07.540583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-258ecde2-300b-4156-b3a2-bda468afb8b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.187933 Aug 02 10:46:07.541286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1421/2360] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:08.366571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:08.367348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:08.374535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:08.374978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:08.375831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:08.376263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:08.523268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:08.536143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:08.538024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:08.539409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b9f0b490-7345-4971-83fd-e2587c9828f7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177533 Aug 02 10:46:08.540002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1422/2361] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:08.563465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:08.564092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:08.571313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:08.571760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:08.572542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:08.572979 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:08.577618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:08.716987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:08.726063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-59f1c6d2-3129-44d9-8f5f-030ae222c634 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166501 Aug 02 10:46:08.726648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1423/2362] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:09.566484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:09.567156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:09.570491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:09.574180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:09.574630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:09.575445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:09.575874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:09.718936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:09.728871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:09.730713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:09.731962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-898b4660-5d33-4cf4-a32c-52d8c5d5a4c1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.170161 Aug 02 10:46:09.732543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1424/2363] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:09.748318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:09.748938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:09.756794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:09.757396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:09.758179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:09.758647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:09.911076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:09.920536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5969ec4-f29b-4f1e-be05-6a464266cd92 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.176060 Aug 02 10:46:09.921136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1425/2364] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:10.757342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:10.758145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:10.766215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:10.766666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:10.767581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:10.768023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:10.919020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:10.929613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:10.932805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:10.932805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-871e1de6-eba7-4f16-8165-3ffa59a48eda tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.180360 Aug 02 10:46:10.933347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1426/2365] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:10.942792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:10.943481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:10.950197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:10.950647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:10.951477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:10.951911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:11.113234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:11.125387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9d037ec3-4a40-4c9a-a50c-cf9d1fdc5a1e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.186495 Aug 02 10:46:11.126092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1427/2366] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:11.970376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:11.971112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:11.978254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:11.978703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:11.979583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:11.980012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:12.133795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:12.143178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:12.144928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:12.146183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e49d6273-03ec-4384-8188-1ecd9d7056f5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.180305 Aug 02 10:46:12.146775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1428/2367] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:12.151572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:12.152191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:12.158860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:12.159355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:12.160139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:12.160578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:12.308784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:12.318190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-52031da5-0192-4ee8-8dc0-677718064190 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170289 Aug 02 10:46:12.318784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1429/2368] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:13.171852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:13.172621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:13.180074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:13.180714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:13.181630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:13.182350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:13.341738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:13.358007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:13.361360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:13.363738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eda82581-78a7-4dd3-a571-0d7c0f9fa8b6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.195899 Aug 02 10:46:13.364780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1430/2369] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:13.373943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:13.375035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:13.387602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:13.388409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:13.389886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:13.390714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:13.545050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:13.554450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-be907e7e-74f0-4262-8610-e89e230bdefc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.188076 Aug 02 10:46:13.555088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1431/2370] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:14.388588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:14.389255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:14.396151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:14.396601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:14.397378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:14.397811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:14.665587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:14.674485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:14.676097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:14.677311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0240f0b2-936f-4d12-a892-0d977b42d709 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.292838 Aug 02 10:46:14.677886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1432/2371] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:14.825884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:14.826495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:14.834941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:14.835423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:14.836230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:14.836657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:14.976091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:14.984920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d08a7a6a-db7a-4de2-aec4-40d384aeeda0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.305962 Aug 02 10:46:14.985514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1433/2372] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:15.701780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:15.702445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:15.709258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:15.709710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:15.710477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:15.710911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:15.857509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:15.867775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:15.869369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:15.870604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-17653f3e-52f0-4ed8-816e-625df9db7501 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.173034 Aug 02 10:46:15.871164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1434/2373] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:15.952416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:46:15.953180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:46:16.007378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:16.008028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:16.014596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:16.015040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:16.015861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:16.016295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:16.163050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:16.171597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-df2e2adc-74db-4211-8b66-63001832470f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.169087 Aug 02 10:46:16.172193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1435/2374] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:16.895822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:16.896551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:16.903551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:16.904003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:16.904784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:16.905235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:17.053647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:17.063239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:17.064770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:17.066495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-75e37bd9-dc4a-4b27-97f4-81ef113f2aa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.174720 Aug 02 10:46:17.067052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1436/2375] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:17.194785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:17.195440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:17.201958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:17.202408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:17.203252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:17.203695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:17.346140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:17.354521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-341f4cd8-ad94-4a7d-b6a9-91b75124d7c3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164233 Aug 02 10:46:17.363287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1437/2376] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:18.090596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:18.091381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:18.099412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:18.099865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:18.100691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:18.101127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:18.244445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:18.253788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:18.255656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:18.256852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fbb99629-93db-46e1-9545-2c8b8c50c4d1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.170460 Aug 02 10:46:18.257420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1438/2377] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:18.376911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:18.377432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:18.384935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:18.385507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:18.386281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:18.386709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:18.531400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:18.534927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:18.540147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ebb9ad33-fca7-4624-ab5b-d053c9b80f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167235 Aug 02 10:46:18.540736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1439/2378] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:19.280788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:19.281458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:19.288956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:19.289396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:19.290157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:19.290582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:19.439018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:19.447959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:19.449539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:19.450693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5b6b49e-3a8f-4322-aba6-77a191532497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.173870 Aug 02 10:46:19.451830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1440/2379] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:19.562816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:19.563482 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:19.569684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:19.570135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:19.570897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:19.571369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:19.709209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:19.717839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6f52c2d3-c484-4c0a-a39a-500bd5267d5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160341 Aug 02 10:46:19.718463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1441/2380] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:20.474704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:20.475474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:20.482036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:20.482476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:20.483307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:20.483747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:20.615486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:20.624454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:20.625990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:20.627179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6981646-4430-47c0-9230-6c2b9543f18c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157106 Aug 02 10:46:20.628267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1442/2381] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:20.740255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:20.741044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:20.747871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:20.748314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:20.749088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:20.749518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:20.886168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:20.894662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6bdfcd08-49e3-4757-b1b1-574f6a2275dd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158386 Aug 02 10:46:20.895273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1443/2382] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:21.651892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:21.652564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:21.659391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:21.659830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:21.660588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:21.661020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:21.832838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:21.841573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:21.843148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:21.844329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6db98b36-9c0d-4cdb-b657-4e55df22d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.196652 Aug 02 10:46:21.844882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1444/2383] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:21.916431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:21.917054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:21.923268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:21.923719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:21.924519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:21.925450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:22.059463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:22.068662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3fa9d061-028c-4d08-a3cb-655686041b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156089 Aug 02 10:46:22.069286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1445/2384] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:22.743668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:22.744365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:22.750889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:22.751375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:22.752234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:22.752671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:22.777448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-318a6786-3c83-435a-b3d8-1694c6076255 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77/ips" status: 200 len: 150 microversion: 2.1 time: 0.037803 Aug 02 10:46:22.778020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1446/2385] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:46:22 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:46:22.868398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:22.868915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:22.875346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:22.876073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:22.876855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:22.877292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:23.014609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:23.023519 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:23.025035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:23.026437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-adc9cf56-45de-4745-af45-fa0b619e878f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161854 Aug 02 10:46:23.026755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1447/2386] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:23.090063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:23.093784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:23.097369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:23.097841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:23.098584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:23.099016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:23.233346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:23.242026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d119dad0-fb76-446c-b60a-861848a30b00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155890 Aug 02 10:46:23.242602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1448/2387] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:24.050007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:24.050743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:24.057292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:24.057728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:24.058475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:24.058903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:24.191753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:24.200327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:24.202028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:24.203257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97f3cd38-bac1-4abe-bb6a-6a8afaac68f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157129 Aug 02 10:46:24.203804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1449/2388] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:24.262997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:24.263639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:24.270468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:24.270915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:24.271725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:24.272170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:24.404289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:24.413058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3333c47-9e2f-4dd9-b70f-7c1431c98661 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153840 Aug 02 10:46:24.413664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1450/2389] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:25.227832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:25.228488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:25.235170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:25.235640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:25.236455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:25.236881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:25.371498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:25.380559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:25.382047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:25.383209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18570546-95da-4c43-a650-bb808d8cf576 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.159524 Aug 02 10:46:25.383771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1451/2390] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:25.434323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:25.435055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:25.441302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:25.441891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:25.442564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:25.443000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:25.589898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:25.598937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c122aad-5cc3-47f0-8980-532393da25fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.168578 Aug 02 10:46:25.599640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1452/2391] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:26.407334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:26.408021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:26.414392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:26.414833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:26.415628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:26.416056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:26.546013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:26.555639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:26.557246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:26.558493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1dbc8d68-b928-483d-b4e3-fd4eb898e13e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155212 Aug 02 10:46:26.559046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1453/2392] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:26.619915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:26.620518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:26.626646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:26.627079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:26.627856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:26.628283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:26.762851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:26.771230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-86692035-f41c-475d-9e78-df9f24b44ae3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155155 Aug 02 10:46:26.771812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1454/2393] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:27.584451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:27.585144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:27.591600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:27.592052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:27.592815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:27.593253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:27.724537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:27.733143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:27.739485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:27.739485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1c14f39d-cf35-4e46-81cf-5e430ed4d9c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156310 Aug 02 10:46:27.739485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1455/2394] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:27.793885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:27.794444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:27.800971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:27.801421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:27.802185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:27.802619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:27.937501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:27.941530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:27.946396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de508503-e7c6-4122-b1bb-3261ff79f3b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156439 Aug 02 10:46:27.946978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1456/2395] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:28.761172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:28.761905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:28.769796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:28.770318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:28.771116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:28.771574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:28.905759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:28.914709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:28.916270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:28.917562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-500b277c-1685-40b8-bb4b-e3bffb3d806d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160285 Aug 02 10:46:28.918116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1457/2396] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:28.968188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:28.968818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:28.974950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:28.975433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:28.976196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:28.976629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:29.265295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:29.273493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb24d7a7-1609-453e-a03c-5a18c01a3b4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.309081 Aug 02 10:46:29.274064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1458/2397] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:29.941705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:29.942381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:29.948868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:29.949307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:29.950077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:29.950521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:30.084623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:30.093358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:30.094867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:30.096054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a251cc52-442d-4646-a9db-40fc77700444 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.158378 Aug 02 10:46:30.096596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1459/2398] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:30.295273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:30.295882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:30.302521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:30.302956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:30.303750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:30.304177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:30.436169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:30.444909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-89aec14a-a607-4f8c-bb02-a9055a45a630 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153840 Aug 02 10:46:30.449135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1460/2399] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:31.119903 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:31.120584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:31.127614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:31.128564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:31.129337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:31.129764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:31.263405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:31.273091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:31.274674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:31.275889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cbe2ae44-4a3e-4406-987e-8c369635dda9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160106 Aug 02 10:46:31.276465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1461/2400] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:31.469079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:31.469561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:31.475813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:31.476261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:31.477046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:31.477486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:31.609839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:31.618740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f8a780f0-1386-4959-b419-6081c2d2df97 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153746 Aug 02 10:46:31.619321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1462/2401] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:32.299624 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:32.300868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:32.307622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:32.308070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:32.308831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:32.309261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:32.456869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:32.460542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:32.462151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:32.463432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-23cdd854-d5e2-4846-8015-eb97d9a28313 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.167771 Aug 02 10:46:32.463983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1463/2402] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:32.641711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:32.642242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:32.649135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:32.649571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:32.650346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:32.650784 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:32.790323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:32.798578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c50e891f-f517-4028-badb-6ecebf40cd08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161103 Aug 02 10:46:32.799160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1464/2403] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:33.487211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:33.487901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:33.494982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:33.495466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:33.496230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:33.496664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:33.636206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:33.644742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:33.646347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:33.648053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f14fe0ca-7e60-414e-b7fc-4254f9793b5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.165001 Aug 02 10:46:33.648635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1465/2404] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:33.821486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:33.822108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:33.828544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:33.828963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:33.829741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:33.830179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:33.977946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:33.985446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-19252f5e-204d-4f91-9474-a5dec70144fd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167855 Aug 02 10:46:33.986133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1466/2405] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:34.674039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:34.674729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:34.682220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:34.682716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:34.685993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:34.685993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:34.816182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:34.824926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:34.826450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:34.827642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ccf8de73-5b43-45e3-97d3-cfe08e61fa98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157584 Aug 02 10:46:34.828202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1467/2406] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:35.008239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:35.008887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:35.015319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:35.015805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:35.016566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:35.016993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:35.151776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:35.160038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3cf52118-bb5d-490f-b96b-72e42c55b535 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155960 Aug 02 10:46:35.160592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1468/2407] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:35.852722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:35.853417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:35.860112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:35.860558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:35.861317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:35.861746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:35.998619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:36.007466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:36.008983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:36.010150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0a870cc4-4ac8-4d14-9151-1450d66d65a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161538 Aug 02 10:46:36.010704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1469/2408] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:36.181596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:36.182117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:36.188210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:36.188657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:36.189421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:36.189857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:36.318211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:36.326559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2ad4df0-261a-4c92-8092-f2ec4a754428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148940 Aug 02 10:46:36.327182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1470/2409] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:37.034188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:37.034850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:37.041742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:37.042192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:37.043010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:37.043475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:37.184263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:37.193568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:37.200319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:37.200319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b3b217f9-0e19-4965-87b0-9115fdee8c29 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.166144 Aug 02 10:46:37.200319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1471/2410] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:37.349233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:37.349925 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:37.356114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:37.356555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:37.357399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:37.357835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:37.490701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:37.498827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-59fed83e-42e5-425d-b807-7f070e722a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154119 Aug 02 10:46:37.499421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1472/2411] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:38.220583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:38.221288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:38.227874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:38.228328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:38.229093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:38.229527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:38.257284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:38.373625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:38.383684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:38.385210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:38.386372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-afb189df-85cd-402d-a0cd-3f5c59a8f2bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.169932 Aug 02 10:46:38.386926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1473/2412] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:38.520433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:38.521050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:38.523954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:38.527467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:38.527928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:38.528701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:38.529141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:38.658797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:38.669188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1eec1d07-0860-424c-8a1b-79cd8609507c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152568 Aug 02 10:46:38.669759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1474/2413] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:39.410208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:39.410922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:39.417730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:39.418172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:39.418930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:39.419392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:39.551775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:39.560227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:39.561762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:39.562941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-254fe4b8-c78d-48d3-951a-ed059252391a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157144 Aug 02 10:46:39.563539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1475/2414] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:39.692786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:39.693394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:39.699495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:39.699936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:39.700815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:39.701242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:39.833207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:39.841269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-622a10cb-cc0c-4c0f-a58f-4321184316ca tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153096 Aug 02 10:46:39.841845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1476/2415] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:40.586326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:40.587011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:40.593511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:40.593954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:40.594719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:40.595150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:40.726376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:40.734952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:40.736538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:40.738215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d75f51e6-6ec7-473c-9498-4e46a9a1ea36 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155841 Aug 02 10:46:40.738769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1477/2416] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:40.863495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:40.864116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:40.870293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:40.870743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:40.871544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:40.871986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:41.003080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:41.011354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-da37d717-8338-41d8-921f-0bc988c9be00 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152515 Aug 02 10:46:41.011953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1478/2417] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:41.762490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:41.763239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:41.770731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:41.771175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:41.771964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:41.772396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:41.913970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:41.922701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:41.924257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:41.925429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cdaccf3f-01ee-4384-ae63-b456fe55e9e9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.167054 Aug 02 10:46:41.925994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1479/2418] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:42.032910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:42.033528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:42.039683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:42.040136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:42.040907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:42.041353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:42.170388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:42.178847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-49996348-aae4-438d-8c2b-3f6283557603 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.149846 Aug 02 10:46:42.179445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1480/2419] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:42.949281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:42.949917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:42.957104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:42.957551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:42.958315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:42.958752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:43.091276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:43.100332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:43.101859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:43.103026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-25f86b17-907b-4928-82f1-911ba52d05a2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.158011 Aug 02 10:46:43.103607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1481/2420] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:43.200660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:43.201195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:43.207899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:43.213132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:43.213132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:43.213132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:43.338856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:43.346959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-74f493ce-76b3-4dfa-8b83-980f4869ffd6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150234 Aug 02 10:46:43.347560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1482/2421] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:44.128678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:44.129385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:44.136400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:44.136854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:44.137623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:44.138058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:44.276859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:44.285841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:44.287396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:44.288564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e193089-84f9-49a0-bb36-9a183b039dcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164428 Aug 02 10:46:44.289125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1483/2422] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:44.369075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:44.369692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:44.376146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:44.376600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:44.377401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:44.378492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:44.507411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:44.515590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d35e30e3-30ab-4256-914f-00b01e3b715c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150392 Aug 02 10:46:44.516208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1484/2423] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:45.313415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:45.314115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:45.320506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:45.320954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:45.321724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:45.322163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:45.463862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:45.473192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:45.475124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:45.476346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c26f790c-0750-4d8d-bf22-6084e19e23aa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.167219 Aug 02 10:46:45.476910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1485/2424] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:45.538307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:45.538970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:45.545500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:45.545964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:45.546737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:45.547289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:45.678158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:45.687310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7d2ee36a-a5ad-48bd-9206-0b5f371ae57e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153440 Aug 02 10:46:45.687881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1486/2425] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:46.502529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:46.503260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:46.510309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:46.510792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:46.511608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:46.512179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:46.650347 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:46.658976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:46.660546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:46.662341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fd187f4d-6874-4dad-a337-b9c4b386689f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.165397 Aug 02 10:46:46.662902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1487/2426] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:46:46.709408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:46.710026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:46.716329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:46.716786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:46.717559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:46.718005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:46.853094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:46.861128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0a9a12a3-8af5-4c9e-8170-7d1295a36d56 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156289 Aug 02 10:46:46.862018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1488/2427] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:47.685483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:47.686170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:47.692919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:47.693363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:47.694128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:47.694591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:47.832724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:47.844706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:47.846777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:47.848390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-299175d7-db65-45e0-af61-b599d9cdddac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.166712 Aug 02 10:46:47.849480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1489/2428] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:47.881739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:47.882269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:47.888545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:47.888997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:47.889783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:47.890221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:47.894460 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:48.029202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:48.040018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bcd17c0a-6673-4e50-999f-1de670553cbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.162248 Aug 02 10:46:48.040611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1490/2429] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:48.873657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:48.874396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:48.882126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:48.882630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:48.883564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:48.884044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:49.038809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:49.048037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:49.049621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:49.050815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2c1ef33e-09f4-4a14-b645-6ae8136bdf67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.181382 Aug 02 10:46:49.051399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1491/2430] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:49.062531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:49.063176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:49.070529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:49.070969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:49.071779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:49.072219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:49.208838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:49.217513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc8207c4-f311-45de-85be-13a65a9db4e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158934 Aug 02 10:46:49.218093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1492/2431] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:50.074717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:50.075496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:50.082716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:50.084091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:50.085444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:50.086169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:50.226058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:50.234926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:50.236497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:50.237771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-19792ac8-b2f0-4b5c-ad55-e4ef357b37f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.167157 Aug 02 10:46:50.238320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1493/2432] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:50.243375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:50.243974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:50.250107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:50.250553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:50.251357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:50.251810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:50.383441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:50.391629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5bf15435-8c3f-4264-beb9-77c293823ba1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152283 Aug 02 10:46:50.392206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1494/2433] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:51.262159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:51.262835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:51.269583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:51.270031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:51.271343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:51.271791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:51.410621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:51.419963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:51.421500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:51.422697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b3017137-c6c5-41a7-a376-71e08c23a87d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164829 Aug 02 10:46:51.423389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1495/2434] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:51.428314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:51.428931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:51.435988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:51.436440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:51.437279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:51.437724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:51.572456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:51.580997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fa2287c0-3a92-400c-88c0-9e0608cb75f7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156555 Aug 02 10:46:51.581567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1496/2435] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:52.446185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:52.448313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:52.453520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:52.453970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:52.454747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:52.455221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:52.591818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:52.603120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:52.604691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:52.605896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9e92bdde-f598-4360-9d5c-f28daf4eeda2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.163728 Aug 02 10:46:52.606445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1497/2436] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:52.611019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:52.611646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:52.618213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:52.618654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:52.619481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:52.619912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:52.748556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:52.757450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a7550ed-86b3-49cd-8b24-43f477e450c4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.149989 Aug 02 10:46:52.758016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1498/2437] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:53.629157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:53.630104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:53.637083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:53.637569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:53.638316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:53.638744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:53.767331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:53.777426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:53.778941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:53.780138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-141159dc-dd26-4127-a257-de0cb35a7be1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155117 Aug 02 10:46:53.780688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1499/2438] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:53.785387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:53.786543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:53.792606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:53.793054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:53.793823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:53.794262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:53.927867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:53.935983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2fd8abc2-b069-4cbc-8792-e5cc76650d29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154338 Aug 02 10:46:53.936545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1500/2439] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:54.804488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:54.805163 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:54.812064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:54.812516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:54.813307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:54.813747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:54.952442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:54.961723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:54.963373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:54.964580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4c8fd74b-dcd7-4753-989c-be62f3ac94a1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164242 Aug 02 10:46:54.965153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1501/2440] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:46:54.970064 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:54.970584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:54.977463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:54.977926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:54.978707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:54.979148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:55.121753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:55.130884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ba0c7bd1-0373-41df-8912-aa1744774fb7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164411 Aug 02 10:46:55.131634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1502/2441] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:55.990129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:55.990834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:55.997682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:55.998130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:55.998901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:55.999369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:56.131540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:56.140015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:56.141515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:56.142658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d26d0bbd-502f-4757-b475-bf78f10d9f24 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157155 Aug 02 10:46:56.143228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1503/2442] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:56.152264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:56.152891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:56.158723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:56.159167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:56.159960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:56.160392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:56.305093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:56.313590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c9c0647-4861-42d4-b782-ea41678db9b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164906 Aug 02 10:46:56.314170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1504/2443] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:57.166975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:57.167676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:57.174170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:57.174616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:57.175421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:57.175857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:57.312745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:57.321970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:57.323537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:57.324683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c5218908-6ed9-4231-bdb0-34a40703e59f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161814 Aug 02 10:46:57.325234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1505/2444] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:57.335654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:57.336266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:57.342465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:57.342917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:57.343760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:57.344246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:57.475522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:57.478997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:46:57.579713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5024c96c-7da3-41da-943c-da0b27a26369 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.248178 Aug 02 10:46:57.580310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1506/2445] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:46:58.349492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:58.350510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:58.358189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:58.358634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:58.359463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:58.359895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:58.733259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:58.742583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:58.744127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:58.745310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6919a58b-f131-4062-a070-e548698b5b61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.400390 Aug 02 10:46:58.746025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1507/2446] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:58.750546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:58.751154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:58.757960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:58.758515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:58.759226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:58.759662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:58.902077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:58.910616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4b372fc-edd2-42b0-be5d-da9d84158bb0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163560 Aug 02 10:46:58.911279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1508/2447] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:46:59.769082 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:59.769788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:59.777100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:59.777546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:59.778308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:59.778741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:59.913388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:59.922532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:59.924162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:46:59.925372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2465b94c-bff4-4d3f-8e4a-f560cc8980ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160273 Aug 02 10:46:59.925948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1509/2448] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:46:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:46:59.933350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:46:59.933967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:46:59.940344 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:59.940791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:46:59.941576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:46:59.942015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:00.073381 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:00.082030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-95eb64b7-7167-4994-9d01-af6489ad3717 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152324 Aug 02 10:47:00.082598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1510/2449] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:46:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:00.949959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:00.950616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:00.957488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:00.958446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:00.959268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:00.959706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:01.092181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:01.100981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:01.102534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:01.103767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c43baf84-1017-4402-9b7a-b91571e69b03 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157998 Aug 02 10:47:01.104323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1511/2450] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:01.108795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:01.109408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:01.115512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:01.115963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:01.116725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:01.117161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:01.254950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:01.263901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dcee0d19-8f59-4a1e-b001-b7e6d44d9b28 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158528 Aug 02 10:47:01.264492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1512/2451] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:02.128679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:02.129457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:02.137573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:02.138022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:02.138961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:02.139590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:02.276412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:02.285241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:02.287392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:02.288620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b7b6635-535f-4dd4-b7ad-05b7c437c566 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164356 Aug 02 10:47:02.289388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1513/2452] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:02.293679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:02.294281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:02.300643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:02.301099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:02.301848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:02.302282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:02.434120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:02.442329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-22cdfa8c-a01a-45c3-acae-656c90ae2479 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152164 Aug 02 10:47:02.443033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1514/2453] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:03.311098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:03.311813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:03.318861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:03.319330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:03.320087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:03.320517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:03.446982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:03.455493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:03.457107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:03.458909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46d5fd7c-f676-4d51-878b-bded06eb0a18 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.151660 Aug 02 10:47:03.459491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1515/2454] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:03.463947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:03.464540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:03.470500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:03.471005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:03.471897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:03.472387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:03.607888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:03.616278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6ed3a939-ad87-4359-83a5-d947fad16790 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155700 Aug 02 10:47:03.616855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1516/2455] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:04.483407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:04.484102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:04.490518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:04.490955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:04.491731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:04.492159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:04.620046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:04.628539 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:04.630661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:04.632119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-87bcb9a0-c48d-47bb-bdea-655b36cfb40d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153256 Aug 02 10:47:04.632711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1517/2456] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:04.637552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:04.638169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:04.644271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:04.644722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:04.645538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:04.645996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:04.770218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:04.778162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06346ded-9331-43b1-9ede-4da32dc6432c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.144163 Aug 02 10:47:04.778719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1518/2457] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:05.656043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:05.656802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:05.663613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:05.664054 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:05.664815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:05.665246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:05.799233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:05.807720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:05.809247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:05.810403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-26789fc9-983d-4676-b468-6814abc3a904 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.158691 Aug 02 10:47:05.810956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1519/2458] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:05.815303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:05.815916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:05.822423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:05.822869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:05.823776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:05.824213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:05.955499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:05.963623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-296a4e3d-238e-4ff0-90e3-4bf66942f2a7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151651 Aug 02 10:47:05.964192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1520/2459] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:06.833754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:06.834613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:06.841337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:06.841780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:06.842549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:06.842981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:06.985331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:06.994936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:06.996508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:06.997678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4d60e281-9fe5-4cf3-9fa5-a63e4eb3e2ae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.168032 Aug 02 10:47:06.998244 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1521/2460] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:07.003439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:07.004472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:07.015531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:07.016294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:07.017585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:07.018326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:07.155487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:07.165194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3ebed3e9-4414-446c-a3cd-e385bf0deb9a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165899 Aug 02 10:47:07.165773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1522/2461] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:08.022638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:08.023612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:08.030308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:08.030763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:08.031585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:08.032025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:08.051729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:08.167765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:08.176948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:08.178475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:08.180363 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-449afe56-3448-4457-bce0-1630f35ebf9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161789 Aug 02 10:47:08.181020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1523/2462] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:08.185907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:08.186553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:08.190536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:08.195319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:08.195319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:08.196109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:08.196553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:08.343407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:08.349568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eab0fe57-1665-4121-8de0-7cca15146ea5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167450 Aug 02 10:47:08.350168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1524/2463] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:09.203113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:09.204134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:09.211117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:09.211589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:09.212362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:09.212793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:09.341894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:09.350328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:09.351906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:09.353076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-52fbc610-405a-48a2-9ebd-eef7c224cec0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153924 Aug 02 10:47:09.353704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1525/2464] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:09.369641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:09.370245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:09.376382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:09.376828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:09.377584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:09.378024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:09.516636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:09.525823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-380e4df3-8769-4c83-b525-0ce066e6550a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159927 Aug 02 10:47:09.527293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1526/2465] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:10.376009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:10.376724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:10.383631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:10.384155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:10.384847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:10.385287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:10.513621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:10.522176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:10.523848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:10.524987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d885de01-e4ba-42be-8d19-ca5d48a346fe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.152913 Aug 02 10:47:10.525540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1527/2466] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:10.549800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:10.550408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:10.556855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:10.557295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:10.558045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:10.558475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:10.694884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:10.703043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f9a9845d-142e-476f-860e-d3dce5df657f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156985 Aug 02 10:47:10.703652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1528/2467] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:11.549297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:11.549981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:11.557435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:11.557881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:11.559078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:11.559078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:11.702597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:11.711998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:11.713551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:11.714711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e69cd59c-b260-4cc0-85ee-59b199a06553 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.169516 Aug 02 10:47:11.715314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1529/2468] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:11.724786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:11.725392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:11.731458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:11.731904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:11.732661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:11.733095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:11.860658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:11.869232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-64646dd9-448c-42dc-ab91-349585e6dfc4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148035 Aug 02 10:47:11.869798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1530/2469] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:12.738308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:12.739012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:12.745577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:12.746022 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:12.746786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:12.747257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:12.881895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:12.890611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:12.892151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:12.893343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a416855e-0c19-486b-900f-b55f3df51d93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.159000 Aug 02 10:47:12.894093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1531/2470] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:12.899148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:12.899773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:12.907153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:12.907619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:12.908537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:12.908965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:13.041891 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:13.050189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-37f041bc-a11a-44ed-a32b-289acb849bce tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155097 Aug 02 10:47:13.050752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1532/2471] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:13.918781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:13.919516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:13.926143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:13.926586 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:13.927388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:13.927841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:14.063693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:14.072296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:14.073824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:14.075131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8f465d3b-1a38-4ec5-bd9b-0d6d7ca29367 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160483 Aug 02 10:47:14.075740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1533/2472] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:14.080151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:14.080747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:14.086578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:14.087019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:14.087817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:14.088260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:14.219264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:14.227944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aa3c3f1c-7461-4130-b4c4-de962f6288da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151237 Aug 02 10:47:14.228513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1534/2473] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:14.900961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb HTTP/1.1 Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:47:14.903222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:47:14.906671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '88583914-a127-4108-9fd8-74a4a6707e47', 'id': '89f9129b-1383-45ca-a98c-8dfae942d3cb'} Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:47:14.908227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:47:14.909462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:47:14.910910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:47:14.912320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) Aug 02 10:47:14.913965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dafc00f9-0d30-4332-931a-57f86a590c62) {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb" status: 400 len: 269 microversion: 2.1 time: 239.755076 Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (ip 10.222.0.49) !!! Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:47:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb (10.222.0.49) Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: CRITICAL nova [None req-6ddd8a53-ca4e-439a-a2ca-71d9f29e9c36 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Unhandled error: OSError: write error Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova OSError: write error Aug 02 10:47:14.915338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova Aug 02 10:47:14.915957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 940/2474] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:43:15 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47/os-volume_attachments/89f9129b-1383-45ca-a98c-8dfae942d3cb => generated 0 bytes in 239757 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 10:47:15.098578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:15.099218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:15.105437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:15.105895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:15.106682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:15.107616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:15.243621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:15.250129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:15.254476 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:15.254632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:15.254632 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:15.255379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dcc5fecc-73f4-45c5-a518-52ef9e3bf625 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161180 Aug 02 10:47:15.255939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1535/2475] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:15.259392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:15.259833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:15.260648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:15.261074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:15.403495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:15.411726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a5e7b80f-7998-4061-987e-6b4c9b82c3c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166440 Aug 02 10:47:15.414330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 941/2476] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:16.282143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:16.282769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:16.290065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:16.290506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:16.291316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:16.291749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:16.432877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:16.433432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:16.434054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:16.440790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:16.441238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:16.442007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:16.442195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:16.442431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:16.443564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:16.445573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e00132c4-d56f-41e6-b80d-ef21aeb1a43b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.167455 Aug 02 10:47:16.446134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1536/2477] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:16.578570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:16.587740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18bd717b-c167-4229-af9d-8461991ab741 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158051 Aug 02 10:47:16.588313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 942/2478] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:17.468781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:17.469417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:17.476434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:17.476879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:17.477651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:17.478081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:17.610203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:17.610810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:17.618081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:17.618393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:17.618529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:17.619348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:17.619779 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:17.627271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:17.628811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:17.630015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de42fab3-6b18-4632-bda9-1f0007bb70e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.165246 Aug 02 10:47:17.630794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1537/2479] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:18.027888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:18.036074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13aa0bfd-12b4-47b5-a047-47d168236bf4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.429890 Aug 02 10:47:18.036648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 943/2480] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:18.653573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:18.654181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:18.660957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:18.661395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:18.662176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:18.662605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:18.812565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:18.822534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:18.824112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:18.825284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ccb478de-2ccf-44b7-b3e0-b792a4897ffa tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.175807 Aug 02 10:47:18.825846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1538/2481] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:19.060134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:19.060721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:19.067515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:19.067963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:19.068732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:19.069661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:19.208527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:19.217537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0b39c895-1500-4f2e-b4bc-4e0a6f87cd29 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161378 Aug 02 10:47:19.218124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 944/2482] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:19.849067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:19.849710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:19.857197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:19.857640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:19.858434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:19.858861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:19.999055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:20.017597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:20.019114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:20.020430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4ebde89c-ddbd-4f78-8617-089b45c6247f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.175467 Aug 02 10:47:20.020998 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1539/2483] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:20.239290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:20.239853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:20.246572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:20.247012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:20.247809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:20.248240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:20.386195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:20.394661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2ad1c45e-277e-441a-bd7a-950ae46f989f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159308 Aug 02 10:47:20.395281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 945/2484] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:21.043261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:21.043867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:21.051595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:21.052187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:21.053272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:21.054374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:21.059827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:21.205043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:21.214127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:21.215700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:21.216895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7552a2ba-9ffc-42c0-a961-19085b8f8768 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177769 Aug 02 10:47:21.217466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1540/2485] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:21.417882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:21.418513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:21.425006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:21.425449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:21.426358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:21.426789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:21.580415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:21.585475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-39688a87-dbc7-458d-a894-40fdc1f65e16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.172115 Aug 02 10:47:21.586087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 946/2486] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:22.239263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:22.239880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:22.246603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:22.247053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:22.247864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:22.248297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:22.374917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:22.384325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:22.385840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:22.386995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-420651f5-1253-4ee2-bbb5-1092dad937c4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.151714 Aug 02 10:47:22.387599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1541/2487] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:22.606820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:22.607500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:22.613990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:22.614435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:22.615212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:22.615653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:22.748502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:22.757297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cdba75ed-75ca-4a07-bd1e-c081e7bc8d5e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153607 Aug 02 10:47:22.757900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 947/2488] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:23.410505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:23.411084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:23.417802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:23.418250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:23.419027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:23.419496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:23.550716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:23.559816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:23.561322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:23.562464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-af9c9a11-d547-4b12-8cce-ec773f43cf81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155932 Aug 02 10:47:23.563010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1542/2489] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:23.778923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:23.779607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:23.785802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:23.786244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:23.787016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:23.787477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:23.914206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:23.922655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9bae7091-ae8c-4787-8508-50630796615d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.147589 Aug 02 10:47:23.923243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 948/2490] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:24.585334 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:24.585947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:24.592559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:24.593097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:24.593771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:24.594215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:24.727298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:24.735853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:24.737355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:24.738506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6282f74f-ef1b-46d2-9fc7-5b0c845b4cc1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157193 Aug 02 10:47:24.739061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1543/2491] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:24.944876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:24.945439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:24.951892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:24.952331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:24.953117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:24.953575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:25.096050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:25.106338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3439feda-65eb-4219-ac2f-d27061b5f85b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165093 Aug 02 10:47:25.107164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 949/2492] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:25.763160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:25.763876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:25.770220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:25.770666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:25.771656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:25.772061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:25.903720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:25.912650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:25.914275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:25.915503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc7c764a-6828-4591-b8f0-6d0cd6daf51f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156550 Aug 02 10:47:25.916066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1544/2493] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:26.128601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:26.129202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:26.135980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:26.136426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:26.137195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:26.137627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:26.270911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:26.283581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a2e392ec-7882-474f-9a55-79244e4fd451 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158428 Aug 02 10:47:26.284180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 950/2494] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:26.938190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:26.940611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:26.949471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:26.949912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:26.950680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:26.951116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:27.085773 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:27.094390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:27.095955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:27.097119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ed32ddf8-b043-47a4-9f7e-8b44f7c63a8c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.163066 Aug 02 10:47:27.097690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1545/2495] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:27.305191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:27.305833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:27.312347 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:27.312784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:27.313543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:27.313967 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:27.453768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:27.465442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4f7e606-3c88-4913-a639-b8e51fb2ed44 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164610 Aug 02 10:47:27.466051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 951/2496] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:28.120133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:28.120739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:28.127597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:28.128040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:28.128849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:28.129279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:28.275100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:28.284359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:28.285892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:28.287097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a0f0dd21-5889-4b88-955e-2eea7a6e3e3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.171456 Aug 02 10:47:28.288197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1546/2497] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:28.489465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:28.490186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:28.498019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:28.498469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:28.499286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:28.499724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:28.648118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:28.656845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d9d70e0-e5d9-46f5-bf8b-d762bb769c16 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.171492 Aug 02 10:47:28.657437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 952/2498] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:29.310124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:29.310735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:29.317341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:29.317787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:29.318547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:29.318981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:29.449751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:29.458561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:29.460788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:29.461944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b72dd9f-3df2-4254-bf5a-baea473cebf7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155904 Aug 02 10:47:29.462500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1547/2499] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:29.679449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:29.680140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:29.686892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:29.687381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:29.688147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:29.688579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:29.813429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:29.821729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-30baefbe-b4b7-47f2-b4d8-e4a36845e025 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.146952 Aug 02 10:47:29.822293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 953/2500] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:30.486214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:30.486858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:30.493991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:30.494428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:30.495180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:30.495635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:30.636303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:30.645164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:30.646680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:30.648509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2f683ed4-26c2-4c2d-867c-827cba831d3d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.166265 Aug 02 10:47:30.649068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1548/2501] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:30.843204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:30.843813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:30.850966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:30.851446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:30.852211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:30.852643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:30.982909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:30.991586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-273db40c-3188-4331-a292-116678673b91 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151699 Aug 02 10:47:30.992156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 954/2502] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:31.671515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:31.672115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:31.678703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:31.679145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:31.679929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:31.680355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:31.804810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:31.813158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:31.814657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:31.815826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-efba5034-adae-420a-96bb-d77cfa2f4793 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.148198 Aug 02 10:47:31.816380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1549/2503] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:32.013578 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:32.014170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:32.020706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:32.021148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:32.021898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:32.022963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:32.148544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:32.156768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a5879124-b6b1-4279-838a-cee450b9f22f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.147015 Aug 02 10:47:32.157370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 955/2504] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:32.840012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:32.840659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:32.847472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:32.847898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:32.848650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:32.849092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:32.989648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:32.999500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:33.001029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:33.002239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-acb80e0e-e91f-432a-ad0c-f526928dfd55 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.166378 Aug 02 10:47:33.002901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1550/2505] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:33.179030 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:33.179632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:33.186203 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:33.186670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:33.187446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:33.187875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:33.317577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:33.325559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c6caa022-391d-4dce-834a-f9ba7bdd7009 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151159 Aug 02 10:47:33.326120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 956/2506] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:34.026240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:34.028694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:34.033800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:34.034249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:34.035109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:34.035584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:34.175649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:34.184764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:34.186294 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:34.187507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-776957a3-6ac7-4f90-a989-b3944c75a669 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.165188 Aug 02 10:47:34.188071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1551/2507] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:34.346556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:34.347243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:34.354165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:34.354609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:34.355410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:34.355843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:34.374329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:34.489278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:34.497297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-259be6fb-e743-4cae-86ee-2712c2ee0386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154776 Aug 02 10:47:34.497866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 957/2508] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:35.210494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:35.211274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:35.218434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:35.218967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:35.219771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:35.220202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:35.353597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:35.362520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:35.364051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:35.365238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2bad1ee6-f681-40ad-b4b0-1dc1b3b1f0ad tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.158806 Aug 02 10:47:35.366289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1552/2509] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:35.518141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:35.518736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:35.525303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:35.528157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:35.528157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:35.528157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:35.660708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:35.669392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a433939a-c89f-40c1-8b31-feeaf0c72c23 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155187 Aug 02 10:47:35.670038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 958/2510] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:36.389092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:36.389825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:36.396464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:36.396922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:36.398258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:36.398694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:36.531780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:36.540377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:36.541917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:36.543101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78880b33-cbbb-4220-9ccb-1280432d2727 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.158165 Aug 02 10:47:36.543829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1553/2511] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:36.690686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:36.691306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:36.698470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:36.698915 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:36.699709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:36.700147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:36.835935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:36.844039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4539bfe8-fb2f-4663-8745-ff9c690e4034 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157352 Aug 02 10:47:36.844601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 959/2512] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:37.566233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:37.566841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:37.574149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:37.574895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:37.575375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:37.575816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:37.704312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:37.713052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:37.714562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:37.715788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fcc87730-7652-4c3e-96e1-dd76491dec01 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153530 Aug 02 10:47:37.716351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1554/2513] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:37.866133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:37.866741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:37.873199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:37.873634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:37.874430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:37.874857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:38.005434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:38.014447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-57280918-5dcb-42da-8571-9b632cf17832 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152550 Aug 02 10:47:38.015014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 960/2514] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:38.738699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:38.739365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:38.741720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=61 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:38.746473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:38.746953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:38.747792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:38.748235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:38.884184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:38.893047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:38.894727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:38.895929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5749c372-6f2e-43b8-9112-f848b5581b5d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161233 Aug 02 10:47:38.896562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1555/2515] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:39.036781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:39.037377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:39.043994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:39.044428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:39.045179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:39.045605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:39.179399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:39.187587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-62dff36f-8bf6-419a-8975-ef0e4117a345 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154730 Aug 02 10:47:39.188174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 961/2516] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:39.919508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:39.920116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:39.926600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:39.933546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:39.933546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:39.933546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:40.065641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:40.069131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:40.074493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:40.076077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:40.077391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c62e7592-e203-4e70-b7d3-559588ae8b81 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161992 Aug 02 10:47:40.077946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1556/2517] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:40.209964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:40.215561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:40.222364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:40.222819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:40.223614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:40.224042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:40.365075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:40.373712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-449978c7-656d-4eff-ae2a-67814a52bdd9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167742 Aug 02 10:47:40.374271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 962/2518] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:41.101164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:41.101807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:41.108411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:41.108860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:41.109629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:41.110067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:41.244631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:41.253315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:41.254861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:41.256060 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d080651-7987-4e63-931d-48425472418b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.159264 Aug 02 10:47:41.257218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1557/2519] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:41.394636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:41.395224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:41.401694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:41.402142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:41.402902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:41.403373 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:41.530231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:41.538824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-faf465be-b2b1-4561-9356-d41b3055e698 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148148 Aug 02 10:47:41.539433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 963/2520] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:42.280977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:42.281616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:42.288465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:42.288906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:42.289694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:42.290138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:42.421605 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:42.430218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:42.431805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:42.433053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2d7fc3ad-bbaf-4cb5-a8a2-e65a8288e82b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156286 Aug 02 10:47:42.433610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1558/2521] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:42.559497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:42.560119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:42.566658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:42.567104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:42.567899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:42.568337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:42.706316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:42.716413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6dbffab0-f4a1-42d1-b0c4-b2b229e891da tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160492 Aug 02 10:47:42.717404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 964/2522] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:43.456520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:43.457475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:43.464032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:43.464489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:43.465254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:43.465690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:43.597951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:43.606339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:43.608228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:43.609395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-82fba0b4-f7c6-478d-b200-a01c64340950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156819 Aug 02 10:47:43.609960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1559/2523] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:43.738065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:43.738671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:43.745786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:43.746255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:43.747042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:43.747579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:43.885220 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:43.893160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4397c3ab-668f-445d-8f1f-a5f98242fbef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159122 Aug 02 10:47:43.893721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 965/2524] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:44.633923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:44.634536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:44.640909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:44.641355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:44.642114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:44.642550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:44.776138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:44.784706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:44.786289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:44.787484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a2db1512-66f6-4dd8-8555-3ac4141faba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157831 Aug 02 10:47:44.788053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1560/2525] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:44.915750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:44.916357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:44.922275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:44.922718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:44.923507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:44.923938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:45.059643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:45.068124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-120b89f9-3614-4c2c-a37d-dc1d72b05f51 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156899 Aug 02 10:47:45.068690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 966/2526] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:45.812358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:45.812897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:45.819491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:45.819945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:45.821368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:45.821804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:45.952018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:45.961626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:45.963240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:45.964426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93fa5698-1083-4329-a43e-a3b78f1242a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156303 Aug 02 10:47:45.964982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1561/2527] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:46.090398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:46.090978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:46.093230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=53 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:46.098175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:46.098615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:46.099456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:46.099888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:46.231296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:46.239305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c6d6b88-e101-4c34-93ec-986dad4b8572 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152858 Aug 02 10:47:46.239878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 967/2528] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:46.988801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:46.989358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:46.996070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:46.996550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:46.997313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:46.997753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:47.129512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:47.138935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:47.140493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:47.141652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9304f0ad-11f7-44c7-af5e-3d8453463aeb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157060 Aug 02 10:47:47.142215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1562/2529] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:47.261293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:47.261910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:47.268454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:47.268899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:47.269665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:47.270100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:47.400251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:47.408643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bfa1c8b6-917b-44f7-a461-d023be9df5ab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152254 Aug 02 10:47:47.409213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 968/2530] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:48.166595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:48.167308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:48.174649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:48.175106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:48.175907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:48.176352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:48.308256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:48.316732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:48.318311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:48.319500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b2074e3-43e3-4883-8043-af7ff3a86aa1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.157831 Aug 02 10:47:48.320063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1563/2531] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:48.430026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:48.430550 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:48.437829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:48.438278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:48.439045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:48.439515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:48.572125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:48.579952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b28212f5-760b-441c-8522-150686b04097 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153927 Aug 02 10:47:48.580511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 969/2532] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:49.342751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:49.343380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:49.350071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:49.350523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:49.351321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:49.351765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:49.487335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:49.496531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:49.498065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:49.499252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cd318b9d-b0db-4327-8bea-fba5fd990562 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160554 Aug 02 10:47:49.499830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1564/2533] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:49.601352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:49.601871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:49.608346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:49.608855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:49.609605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:49.610034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:49.745829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:49.754093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-273d9026-52a3-4209-92e8-556b8659a321 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156761 Aug 02 10:47:49.754661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 970/2534] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:50.522803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:50.523466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:50.530681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:50.531217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:50.531927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:50.532373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:50.664323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:50.672783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:50.674286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:50.675479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d0f9c907-abe0-499f-b17d-fcc8740c5f1d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156636 Aug 02 10:47:50.676081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1565/2535] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:50.775661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:50.776781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:50.783282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:50.783719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:50.784466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:50.784890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:50.920147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:50.928221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bdb666d0-5740-42c1-ab61-49de91c8f44d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156612 Aug 02 10:47:50.928787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 971/2536] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:51.698841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:51.699479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:51.706025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:51.706481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:51.707269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:51.707710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:51.834508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:51.843059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:51.844677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:51.845826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d904aa3c-53f7-4da7-88f3-ae1398306c98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.151022 Aug 02 10:47:51.846388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1566/2537] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:51.949879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:51.950492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:51.961189 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:51.961633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:51.962419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:51.962856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:52.091443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:52.099627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-860a9c3d-e506-4afc-98fb-9c970023b450 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153613 Aug 02 10:47:52.100216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 972/2538] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:52.868960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:52.869503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:52.876793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:52.877238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:52.878002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:52.878447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:53.009303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:53.017721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:53.019267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:53.020455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-24fdc7fd-383f-430c-8b3b-58ce2d3c9e91 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155601 Aug 02 10:47:53.021008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1567/2539] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:53.121164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:53.121713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:53.128301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:53.128744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:53.129503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:53.129933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:53.261020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:53.269817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e4498a74-f3c3-469c-8c01-fbb7a613fefe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152640 Aug 02 10:47:53.270393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 973/2540] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:54.044283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:54.044948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:54.051659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:54.052103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:54.052862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:54.053292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:54.183833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:54.193179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:54.194701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:54.195893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-96670678-4111-4e26-83c9-44818fda76e6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155666 Aug 02 10:47:54.196458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1568/2541] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:47:54.291451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:54.292111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:54.298881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:54.299299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:54.300063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:54.300497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:54.304569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:54.428910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:54.437980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46d8e379-138a-4c67-81b2-233e044cb646 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150398 Aug 02 10:47:54.438610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 974/2542] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:55.218843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:55.219514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:55.226278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:55.226713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:55.227506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:55.229541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:55.364007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:55.372898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:55.374440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:55.375651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ed7cd88a-9679-4251-8fdb-009d63b5fadc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.161451 Aug 02 10:47:55.376212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1569/2543] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:55.458412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:55.459040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:55.466187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:55.466660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:55.467462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:55.467899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:55.599264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:55.607881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3671617-c129-47ce-ab19-80a570d06bee tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153417 Aug 02 10:47:55.608480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 975/2544] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:56.399938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:56.400594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:56.407109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:56.407578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:56.408337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:56.408774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:56.539972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:56.549870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:56.551449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:56.552617 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cf0f6b4f-33cf-4c3b-bbe4-5964c03f341f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156674 Aug 02 10:47:56.553178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1570/2545] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:56.629313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:56.629922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:56.636728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:56.637174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:56.637939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:56.638376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:56.773257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:56.778721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58e795e4-ba5d-4dc8-9868-9052d0ae80c9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152812 Aug 02 10:47:56.779329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 976/2546] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:57.576931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:57.577546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:57.584113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:57.584564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:57.585324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:57.585793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:57.712025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:57.720413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:57.721914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:57.723077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3db35e9d-cc1a-405a-bcb2-9f9a0401a31b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.150823 Aug 02 10:47:57.723675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1571/2547] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:57.799285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:57.799821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:57.806410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:57.806866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:57.807661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:57.808092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:57.937954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:57.946107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8981176a-3641-40d0-a875-b53a1d70c477 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150814 Aug 02 10:47:57.946681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 977/2548] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:58.746674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:58.747897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:58.753916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:58.754356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:58.755104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:58.755561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:58.887876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:58.896306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:58.897839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:58.899003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-efffacbb-136f-41dc-bf3a-e37f2f4766bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156920 Aug 02 10:47:58.899588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1572/2549] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:58.968159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:58.968797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:58.975368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:58.975809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:58.976653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:58.977084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:59.115589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:47:59.123497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-383e25e6-bb15-4462-b317-0fa1ebf094fe tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159844 Aug 02 10:47:59.124070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 978/2550] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:47:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:59.922655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:59.923233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:47:59.929766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:59.930214 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:59.930975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:47:59.931429 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:47:59.950452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:00.060697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:00.069131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:00.070636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:00.071813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5429d65c-9125-43ac-8447-545caf8ebf76 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153247 Aug 02 10:48:00.072371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1573/2551] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:47:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:00.145046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:00.145711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:00.152659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:00.153186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:00.153966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:00.154390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:00.281658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:00.289563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f57e92f8-ef93-4d6b-b789-7a625f9ff5a6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148577 Aug 02 10:48:00.290130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 979/2552] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:01.095712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:01.096351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:01.102833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:01.103325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:01.104078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:01.104507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:01.236993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:01.245411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:01.246981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:01.248160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-908d20b9-48dd-444f-b0a8-bd80ccff5826 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156493 Aug 02 10:48:01.248717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1574/2553] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:01.311603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:01.312206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:01.318680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:01.319122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:01.319901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:01.320330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:01.452788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:01.460784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-710e0b23-b17b-4445-867f-36d22494a5e4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153513 Aug 02 10:48:01.461345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 980/2554] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:02.156067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:48:02.156706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:48:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:48:02.271584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:02.272189 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:02.279839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:02.280278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:02.281024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:02.281452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:02.410551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:02.419493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:02.421086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:02.422248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5533689d-65ab-45bd-ac73-fe97c6b42b9d tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.154649 Aug 02 10:48:02.422806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1575/2555] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:02.482270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:02.482879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:02.489386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:02.489832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:02.490593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:02.491029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:02.620397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:02.628989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c8e65a47-640d-4a5b-abb6-7a2bd91d994b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151133 Aug 02 10:48:02.629557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 981/2556] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:02.890863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:48:02.891080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:48:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:48:03.446049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:03.446634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:03.453345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:03.453792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:03.454561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:03.454995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:03.600525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:03.610753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:03.612311 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:03.613478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8ed90e67-1650-49af-930d-943004499968 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.171509 Aug 02 10:48:03.614034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1576/2557] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:03.650250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:03.650867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:03.657948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:03.658397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:03.659164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:03.659629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:03.794980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:03.803813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c3ef49d-be4f-4ccf-83c6-fd01aa651a90 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157381 Aug 02 10:48:03.804378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 982/2558] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:04.637521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:04.638203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:04.644929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:04.645379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:04.646186 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:04.646621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:04.782077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:04.790753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:04.792310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:04.794011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f0367f2d-2c7a-47eb-8d27-b3c9e5a7b2cd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160019 Aug 02 10:48:04.794568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1577/2559] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:04.826001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:04.826592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:04.834051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:04.834502 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:04.835310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:04.835790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:04.979468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:04.988520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-078646ce-f6ee-4cab-9686-744828af3f5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166423 Aug 02 10:48:04.989101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 983/2560] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:05.819056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:05.819643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:05.826853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:05.827319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:05.828085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:05.828515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:05.955972 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:05.964882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:05.966422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:05.967622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3b7d71c-45d4-4cf9-a9f1-8e679c004a93 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.152664 Aug 02 10:48:05.968174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1578/2561] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:06.009744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:06.010351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:06.017413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:06.017854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:06.018599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:06.019057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:06.148284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:06.156892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e4789380-cf4e-4667-a0aa-2839bd268a12 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151225 Aug 02 10:48:06.157462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 984/2562] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:06.990975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:06.991579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:06.998964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:06.999448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:07.000226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:07.000659 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:07.139042 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:07.147797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:07.149606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:07.150774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0a3a3794-5d43-4324-ae08-5baa72fd2852 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164363 Aug 02 10:48:07.151349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1579/2563] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:07.177889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:07.178499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:07.185700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:07.186177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:07.186950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:07.187409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:07.321260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:07.330179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-204edbaf-80ae-486c-aede-a38dfaa2eef8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156176 Aug 02 10:48:07.330826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 985/2564] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:08.173862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.174459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:08.180938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:08.181378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:08.182128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:08.182559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:08.314382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:08.323226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:08.325394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:08.326548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e288bda-04b4-43fe-9ff2-c3901906bae7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.156595 Aug 02 10:48:08.327097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1580/2565] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:08.351314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.351931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:08.359223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:08.359669 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:08.360430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:08.360863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:08.490699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:08.499405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7dcdd833-41e4-4753-998d-2a03f1893263 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151955 Aug 02 10:48:08.499979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 986/2566] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:09.349999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.350850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:09.353181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:09.358706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:09.359153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:09.360123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:09.360543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:09.501742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:09.511072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:09.512745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:09.513965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-65e9e271-4471-486a-9ddc-16b89756d5a4 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.168152 Aug 02 10:48:09.514945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1581/2567] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:09.520995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.521608 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:09.529479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:09.529928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:09.530718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:09.531153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:09.669573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:09.678714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b5f0e8d3-cfb3-4f09-bdd8-90521acb1229 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161664 Aug 02 10:48:09.679335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 987/2568] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:10.539845 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:10.540452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:10.546963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:10.547447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:10.548202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:10.548635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:10.677798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:10.686944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:10.688489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:10.689672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d36f47c-7480-4506-ad13-1905f2aeecbd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153660 Aug 02 10:48:10.690235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1582/2569] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:10.701843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:10.703029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:10.710517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:10.710959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:10.711913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:10.712341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:10.844208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:10.852289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6893c7f0-dbe0-4fc5-bd7b-635b8b1f00b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155429 Aug 02 10:48:10.852859 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 988/2570] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:11.717879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.718507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:11.725955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:11.726405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:11.727264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:11.727963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:11.874854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.876182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:11.882396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:11.883657 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:11.884310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:11.885592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:11.886784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:11.893256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:11.893936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:11.895137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-54e61904-48a0-447a-bdac-1666e2c52210 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.181829 Aug 02 10:48:11.896112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1583/2571] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:12.022392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:12.030950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-908eea3e-3416-48bc-b12f-98beb68a53c0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160674 Aug 02 10:48:12.031994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 989/2572] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:12.066790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:48:12.067118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:48:12.919046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:12.919758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:12.926634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:12.927131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:12.928009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:12.928712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:13.051980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:13.052594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:13.059841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:13.060286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:13.061070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:13.061506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:13.078752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:13.087879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:13.089434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:13.091221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b518b549-4595-405c-9d09-cd3ab2280d45 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.176335 Aug 02 10:48:13.091770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1584/2573] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:13.226619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:13.230046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:13.237270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-40dc79bc-0aa9-4e54-998e-c22e3811a843 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.189448 Aug 02 10:48:13.243843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 990/2574] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:14.114351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:14.115166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:14.122355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:14.122806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:14.123661 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:14.124097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:14.258930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:14.259665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:14.266350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:14.268003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:14.268536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:14.269459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:14.269997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:14.276038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:14.277663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:14.278848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ebe99d6f-f503-41fe-a216-2e9eeb86c02c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.168508 Aug 02 10:48:14.279446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1585/2575] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:14.456979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:14.466088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d8ec369-e8ea-440e-a041-3349f1929a8b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.211403 Aug 02 10:48:14.466672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 991/2576] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:15.442993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:15.443647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:15.450046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:15.450547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:15.451350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:15.451785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:15.488201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:15.488801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:15.495527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:15.495963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:15.496726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:15.497157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:15.595211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:15.604126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:15.605813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:15.607556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6af9a44-3bc8-4e6f-a16b-bff66cf29d86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.309194 Aug 02 10:48:15.608118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1586/2577] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:15.640369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:15.646457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edb7afb5-b8c8-48e7-9e97-0cef4259546f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.162144 Aug 02 10:48:15.647023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 992/2578] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:15.890221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:48:15.890448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:48:16.630297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:16.630923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:16.637899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:16.638341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:16.639113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:16.639577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:16.669317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:16.669944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:16.671869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=52 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:16.676922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:16.677375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:16.678316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:16.678662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:16.778953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:16.787967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:16.789430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:16.790627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-402d16e9-908f-4e61-b2da-a533ecf026fd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164551 Aug 02 10:48:16.791596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1587/2579] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:16.825945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:16.834180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8619c022-3ac4-4cd8-95f0-ece1d67cabbd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.169767 Aug 02 10:48:16.836282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 993/2580] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:17.815067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:17.815726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:17.822315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:17.822764 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:17.823596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:17.824037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:17.856874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:17.858068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:17.864959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:17.865625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:17.866444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:17.866869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:17.975952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:17.985198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:17.986838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:17.988108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fa4857fc-ee5c-4fb5-b03a-4e0965f751c5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177117 Aug 02 10:48:17.988674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1588/2581] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:18.014797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:18.023489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-530c9dc6-6412-4004-9473-03dd70a77e5d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.171816 Aug 02 10:48:18.024078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 994/2582] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:19.012588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:19.013206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:19.021203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:19.021646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:19.023288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:19.023728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:19.045745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:19.046498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:19.053334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:19.057913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:19.057913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:19.057913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:19.187367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:19.196289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:19.197793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:19.198869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fdf82a54-b0f4-4b01-813c-b2508488e984 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.190362 Aug 02 10:48:19.199463 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1589/2583] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:19.210008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:19.218709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9dcd7f52-fbb6-49fe-8ccc-1cece7893120 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.177312 Aug 02 10:48:19.219311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 995/2584] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:19.453449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:48:19.453673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:48:20.225080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:20.225861 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:20.233502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:20.233951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:20.234741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:20.235182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:20.240112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:20.244998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:20.246204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:20.258827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:20.259692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:20.261276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:20.262012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:20.395816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:20.410051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:20.411758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:20.413014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5a4c575-fe5b-4f2f-be11-e82d61313e9c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.191967 Aug 02 10:48:20.413592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1590/2585] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:20.435739 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:20.444529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4556c7e-af36-494c-8a5a-2e75a774d40d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.206976 Aug 02 10:48:20.445126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 996/2586] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:21.450196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:21.450759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:21.457338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:21.457779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:21.458528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:21.458955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:21.472093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:21.472711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:21.479208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:21.479690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:21.480457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:21.481485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:21.607962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:21.616988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:21.618635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:21.619904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac2d3b33-e67e-4900-a499-8627176d13da tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.173820 Aug 02 10:48:21.620653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1591/2587] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:21.620836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:21.629377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18371dfb-d899-432b-b309-efe061e3a541 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161188 Aug 02 10:48:21.629955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 997/2588] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:22.644644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:22.645313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:22.652403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:22.653970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:22.653970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:22.654498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:22.654730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:22.654939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:22.662603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:22.663043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:22.663856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:22.664293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:22.807685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:22.814966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:22.816567 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:22.817844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-597114ea-4715-48d8-8002-6d9eaec8cd2b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.177306 Aug 02 10:48:22.818655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1592/2589] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:22.825440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:22.834089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-639e802d-c3f9-4d67-ab77-9052794eac7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.186221 Aug 02 10:48:22.834720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 998/2590] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:23.842436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:23.843017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:23.849809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:23.850263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:23.851136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:23.851622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:23.856750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:23.857593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:23.864313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:23.864760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:23.865538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:23.866078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:23.996613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:24.013456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:24.013456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:24.013994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:24.014134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-023fcebb-1b31-459f-9394-f32f0a3c942b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.170673 Aug 02 10:48:24.014134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1593/2591] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:24.017318 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46e71d37-a062-4d76-b073-bd07eb8fe288 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164733 Aug 02 10:48:24.017946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 999/2592] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:25.033422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:25.034041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:25.041377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:25.041827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:25.042612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:25.043052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:25.043775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:25.044660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:25.051355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:25.052545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:25.052685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:25.053001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:25.205086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:25.217876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:25.219665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:25.222578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:25.224220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5c6cae36-53f7-47a2-b71e-67918520733c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.195087 Aug 02 10:48:25.224949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1594/2593] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:25.230197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3b1c423d-fb07-437f-ba27-bb4574396705 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.192411 Aug 02 10:48:25.231800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1000/2594] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:26.248405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:26.253794 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:26.254647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:26.255331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:26.256713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:26.257169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:26.258517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:26.258650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:26.264041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:26.264501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:26.265283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:26.265716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:26.412248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:26.412876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:26.421520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cb18b461-1f95-4d12-9212-cbbe9b9b89fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.171427 Aug 02 10:48:26.422109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:26.422292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1001/2595] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:26.423720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:26.424971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-86092e0e-331a-4934-a0ab-0c50d6ee88f8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.180999 Aug 02 10:48:26.425543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1595/2596] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:27.448936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:27.450421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:27.452316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:27.452937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:27.459001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:27.459472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:27.460252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:27.461252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:27.464810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:27.465251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:27.466802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:27.467275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:27.600667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:27.602341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:27.609702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:27.611263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:27.612449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5d5e5dd3-87c6-4b71-b477-9f23372ac873 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164723 Aug 02 10:48:27.613114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1596/2597] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:27.614409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-64c3dfec-0d11-415d-92de-53bdae222e14 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.173138 Aug 02 10:48:27.614992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1002/2598] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:28.636921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:28.638201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:28.638546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:28.639168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:28.645137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:28.645687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:28.645916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:28.646317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:28.646476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:28.646894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:28.647102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:28.647550 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:28.784196 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:28.790148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:28.792978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:28.794741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:28.795960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a1cbad03-ca8d-4976-b0b1-5905d9722fa6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.163301 Aug 02 10:48:28.796526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1597/2599] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:28.798776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5cf1d2d5-7247-47f2-98ac-19ecb96cbfbb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164490 Aug 02 10:48:28.799382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1003/2600] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:29.819500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:29.820115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:29.820434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:29.821050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:29.826548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:29.827002 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:29.827522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:29.827776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:29.827963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:29.828209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:29.828725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:29.829164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:29.966691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:29.968958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:29.975611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:29.976958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c218cae-21bb-402f-bf67-0000e2f9fa86 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160442 Aug 02 10:48:29.977117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:29.977747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1004/2601] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:29.978451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-754bf5ab-9d12-4c0c-b6ba-a6d246a5bf2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.162932 Aug 02 10:48:29.979122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1598/2602] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:31.002406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:31.003769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:31.006055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:31.011522 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:31.011711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:31.011711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:31.012712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:31.013429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:31.014672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:31.015138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:31.016300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:31.017736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:31.161910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:31.170317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e3a95265-2b51-411d-863c-406a2e2009e0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167954 Aug 02 10:48:31.171028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1599/2603] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:31.177839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:31.187092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:31.188687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:31.189871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b54d826-eafb-4f21-8a20-e899868c74ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.191803 Aug 02 10:48:31.190439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1005/2604] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:32.191952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:32.192597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:32.199413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:32.199868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:32.200646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:32.201085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:32.213804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:32.214453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:32.221745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:32.222178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:32.222951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:32.223420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:32.339166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:32.348629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a60db97a-5e1b-4de7-8760-cec7fca9f5e5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160553 Aug 02 10:48:32.349410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1600/2605] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:32.358029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:32.367138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:32.368676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:32.369882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5a0bb7cd-5c76-41d1-943e-39043e4a6cfe tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.160164 Aug 02 10:48:32.370437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1006/2606] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:33.371207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:33.371952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:33.378554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:33.379027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:33.379831 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:33.380271 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:33.393785 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:33.394433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:33.401247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:33.401692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:33.402472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:33.403722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:33.422646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:33.521866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:33.535407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-816c362d-f707-4d5c-8779-39b2b5d08e94 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163756 Aug 02 10:48:33.535407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1601/2607] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:33.557110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:33.566679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:33.568236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:33.569407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22bd162c-3216-4526-adea-e37a8222a3ac tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.179693 Aug 02 10:48:33.569970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1007/2608] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:34.552376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:34.552985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:34.560515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:34.561164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:34.562318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:34.562760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:34.592932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:34.593529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:34.600197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:34.600641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:34.601430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:34.601861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:34.694427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:34.702441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ada8b817-1d5f-4756-a7ae-b1332a05e67f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153877 Aug 02 10:48:34.703008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1602/2609] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:34.741428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:34.750659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:34.752212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:34.753370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-51e446b2-a29c-441d-aa2b-829de5be7967 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.164382 Aug 02 10:48:34.753932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1008/2610] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:35.735171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:35.735774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:35.742407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:35.742848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:35.743638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:35.744066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:35.776484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:35.777172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:35.783824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:35.784273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:35.785044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:35.785483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:35.877663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:35.885956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-94e17e77-0a97-417c-ab83-608758167223 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154700 Aug 02 10:48:35.886518 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1603/2611] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:35.917743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:35.925874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:35.927408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:35.928555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-155d509e-276e-4992-b96f-c8bf1c5822f3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.155996 Aug 02 10:48:35.929093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1009/2612] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:36.908093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:36.908625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:36.915104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:36.915573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:36.916324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:36.916752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:36.951977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:36.952567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:36.959376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:36.959819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:36.960574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:36.960999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:37.045291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:37.053443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-396bd625-4dcd-4133-9aeb-99ca3e409afa tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.149374 Aug 02 10:48:37.054041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1604/2613] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:37.090401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:37.098826 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:37.100380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:37.101537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ba8c802-0311-403c-81f5-e33a5522f5d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.153508 Aug 02 10:48:37.102090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1010/2614] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:38.075710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:38.076494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:38.082860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:38.083336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:38.084099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:38.084530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:38.124579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:38.125257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:38.131902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:38.132348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:38.133118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:38.133803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:38.221863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:38.231417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5ee3d41d-aba8-4aaf-be57-98d267f62ade tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160147 Aug 02 10:48:38.232100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1605/2615] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:38.377831 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:38.386712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:38.388432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:38.389621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3f9b9368-7f58-4664-a62c-1fe509333ec7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1799 microversion: 2.20 time: 0.269454 Aug 02 10:48:38.390184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1011/2616] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1799 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:39.114622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-b2813c07-5ad6-4be6-bc22-ec4fd6994d11 req-9d9cca86-824f-455b-960a-910b9f30587e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694dcbbc-916c-4b2a-b571-9225b4c1127f", "name": "network-vif-deleted", "tag": "c6f7c144-692c-4c30-9308-032d33b2ad7d"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:48:39.124850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b2813c07-5ad6-4be6-bc22-ec4fd6994d11 req-9d9cca86-824f-455b-960a-910b9f30587e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:39.125291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b2813c07-5ad6-4be6-bc22-ec4fd6994d11 req-9d9cca86-824f-455b-960a-910b9f30587e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:39.137674 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-b2813c07-5ad6-4be6-bc22-ec4fd6994d11 req-9d9cca86-824f-455b-960a-910b9f30587e service nova] Creating event network-vif-deleted:c6f7c144-692c-4c30-9308-032d33b2ad7d for instance 694dcbbc-916c-4b2a-b571-9225b4c1127f on hv-cinder-84753 Aug 02 10:48:39.143994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-b2813c07-5ad6-4be6-bc22-ec4fd6994d11 req-9d9cca86-824f-455b-960a-910b9f30587e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Aug 02 10:48:39.151552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1606/2617] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:39.252945 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:39.254503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:39.263597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:39.265717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:39.266533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:39.267153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:39.414395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:39.415642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:39.417539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:39.418751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:39.422816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:39.423370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:39.424154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:39.424592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:39.426954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-42280ede-6492-4331-9854-033adfde6c8e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.178301 Aug 02 10:48:39.427800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1012/2618] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:39.445527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:39.495136 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:39.505333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:39.506852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:39.508081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0501ae39-74cd-43ef-bcec-83026ce77ee1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.098388 Aug 02 10:48:39.508904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1607/2619] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:40.448566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:40.449233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:40.455990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:40.456436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:40.457193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:40.457622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:40.532993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:40.533699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:40.540728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:40.541185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:40.541986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:40.542421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:40.608999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:40.619593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:40.621237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:40.622420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-31b5ced5-1fe2-49fa-9594-5a5345fff49e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093561 Aug 02 10:48:40.623010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1608/2620] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:40.746130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:40.754774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0363854f-1481-49de-b619-3de1a704495d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.310090 Aug 02 10:48:40.755387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1013/2621] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:41.646226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:41.646853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:41.654651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:41.655159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:41.655937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:41.656375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:41.719882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:41.728289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:41.729790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:41.730912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f84894ba-a601-4d39-8247-16068696e129 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088689 Aug 02 10:48:41.731507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1609/2622] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:41.776803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:41.777388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:41.784127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:41.784501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:41.785259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:41.785684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:42.184936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:42.193125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edfedc2f-eca8-4798-b49d-24ad1cbd0992 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.420197 Aug 02 10:48:42.193692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1014/2623] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:42.753950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:42.754584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:42.763464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:42.763930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:42.764743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:42.765191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:42.836228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:42.846027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:42.847676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:42.848870 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9def1508-73ae-4571-8759-31e4ebea06d7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.099078 Aug 02 10:48:42.849436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1610/2624] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:43.218231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:43.219327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:43.226934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:43.227415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:43.228188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:43.228612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:43.363906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:43.372585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6331d456-e640-4fc0-8235-4c6c84b71e0a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161498 Aug 02 10:48:43.373148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1015/2625] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:43.872625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:43.873206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:43.879731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:43.880169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:43.880915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:43.881345 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:43.943416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:43.953572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:43.955101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:43.956296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-93531e1f-6896-4da1-8e44-0177350f45d5 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087746 Aug 02 10:48:43.956892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1611/2626] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:44.397713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:44.398839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:44.410557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:44.411420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:44.412856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:44.413679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:44.552301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:44.561084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2884cd65-4497-4395-9d05-642e948a3114 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170707 Aug 02 10:48:44.561658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1016/2627] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:44.979758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:44.980411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:44.987878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:44.988113 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:44.988711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:44.989140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:45.052073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:45.061266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:45.062813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:45.064019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d311a39e-b4c9-4067-ab20-f984d75089ec tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088349 Aug 02 10:48:45.064590 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1612/2628] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:45.582242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:45.582862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:45.590389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:45.591210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:45.591995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:45.592433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:45.729689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:45.738205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-60653a9d-805d-4c5f-9707-855cd1b35ac0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159930 Aug 02 10:48:45.738776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1017/2629] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:46.087020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:46.087663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:46.094355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:46.094828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:46.095628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:46.096070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:46.156878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:46.165645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:46.167149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:46.168817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6c5b679a-26fc-4182-8b41-ff1f8b69ad54 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085228 Aug 02 10:48:46.169476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1613/2630] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:46.761241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:46.761844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:46.764287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=50 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:46.769140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:46.769588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:46.770378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:46.770821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:46.907466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:46.915742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-782c4b8d-61da-48d9-aca2-823e10dfa9e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158796 Aug 02 10:48:46.916312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1018/2631] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:47.191091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:47.191736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:47.198030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:47.198477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:47.199262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:47.199700 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:47.264239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:47.272878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:47.274388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:47.275560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1d66767-5267-40b3-962e-414ec54f4ebc tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088628 Aug 02 10:48:47.276119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1614/2632] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:47.938694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:47.939442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:47.946116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:47.946563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:47.947416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:47.947811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:48.082712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:48.089527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-08bd32df-338a-4dea-a2e0-eba77412c502 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155466 Aug 02 10:48:48.090092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1019/2633] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:48.298581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:48.299341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:48.306224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:48.306665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:48.307477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:48.307906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:48.370442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:48.380052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:48.381585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:48.382738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ac74fb66-f77d-4f07-9540-69e1273368c7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088187 Aug 02 10:48:48.383329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1615/2634] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:49.110520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:49.111117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:49.117771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:49.118219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:49.118979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:49.119438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:49.250462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:49.259321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-48226689-ba32-4eb9-8e15-b0a2c2f3b4d6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152573 Aug 02 10:48:49.259907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1020/2635] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:49.404710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:49.405275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:49.411701 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:49.412149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:49.412904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:49.413336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:49.475056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:49.483782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:49.485309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:49.486454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-456edddd-b372-4158-8562-4ec002f3441a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085851 Aug 02 10:48:49.487009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1616/2636] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:50.282324 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:50.282941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:50.289800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:50.290242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:50.291013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:50.291478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:50.427533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:50.436846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c5a0027d-e99a-49be-99e0-fd94f23f2aef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159381 Aug 02 10:48:50.437433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1021/2637] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:50.510873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:50.512669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:50.519565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:50.520014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:50.520783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:50.521223 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:50.584959 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:50.594277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:50.595834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:50.596964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2984f566-0862-4a5a-8f9e-93bde5cbc13f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090446 Aug 02 10:48:50.597525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1617/2638] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:51.463808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:51.464953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:51.476989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:51.477831 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:51.479150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:51.479975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:51.617691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:51.619476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:51.620241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:51.626529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e3d78b44-df29-477b-979c-d8011146d7b5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170004 Aug 02 10:48:51.626742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:51.631499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:51.631653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1022/2639] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:51.631758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:51.631758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:51.696481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:51.705053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:51.706561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:51.707744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d4bd7b69-f533-43a5-a245-f3ee10259e2c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092345 Aug 02 10:48:51.708297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1618/2640] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:52.648252 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:52.648860 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:52.655448 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:52.655890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:52.656644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:52.657073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:52.732730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:52.733353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:52.740923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:52.741191 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:52.742012 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:52.742458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:52.807581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:52.813452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:52.822465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:52.823734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-acd09c8d-c5d2-4356-8994-94ebce20dcf9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.179180 Aug 02 10:48:52.824141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:52.824784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1023/2641] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:52.825300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-24b382ae-420b-4643-9dfb-8efe12ea64f1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.098027 Aug 02 10:48:52.825867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1619/2642] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:53.850780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:53.852908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:53.859837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:53.860684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:53.862131 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:53.862868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:53.864043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:53.864575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:53.868894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:53.869175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:53.871978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:53.872204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:53.872376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:53.942515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:53.952056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:53.953609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:53.954812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f965eb14-82d9-472a-8934-7caae8c628e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.110895 Aug 02 10:48:53.955404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1024/2643] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:53 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:54.021919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:54.030048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-53311e4e-cd84-4fbe-b41c-5780ee3cd42e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.175772 Aug 02 10:48:54.030628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1620/2644] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:54.978192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:54.978751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:54.985334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:54.985787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:54.986560 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:54.986997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:55.049097 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:55.051114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:55.051792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:55.057503 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:55.058203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:55.058652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:55.059004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:55.059462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:55.059906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:55.060216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c2827a14-1ab9-45d8-b55d-fa2d54afc5bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086111 Aug 02 10:48:55.060783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1025/2645] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:55.193494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:55.202097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7183de6b-df8a-42dd-8f8b-551e3eb4847b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154906 Aug 02 10:48:55.202675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1621/2646] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:48:56.083462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:56.084099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:56.091050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:56.091525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:56.092280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:56.092712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:56.152527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:56.161481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:56.163035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:56.164204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2cdbdb16-beb0-443b-9ba5-dcae36a0632e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.084730 Aug 02 10:48:56.164749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1026/2647] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:56.223656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:56.224360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:56.230987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:56.232035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:56.232787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:56.233227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:56.358744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:56.366708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-76e206b4-a91d-4205-bbd6-f49ff33fa58b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.146981 Aug 02 10:48:56.367291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1622/2648] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:57.188736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:57.189276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:57.196506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:57.196987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:57.197884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:57.198387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:57.261596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:57.270330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:57.271873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:57.273012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a4575c99-6b1f-452b-a517-f0b897d78fcf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.089279 Aug 02 10:48:57.273566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1027/2649] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:57.388133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:57.388746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:57.395382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:57.395866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:57.396628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:57.397055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:57.540856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:57.549398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-582567fa-5a94-40ba-a0f7-39be56054e38 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165397 Aug 02 10:48:57.549973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1623/2650] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:57 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:58.295748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:58.296346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:58.303035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:58.303512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:58.304274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:58.304710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:58.369809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:58.379310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:58.380883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:58.382037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-17cdcb5e-2a76-4e4d-90e9-7c0aea259503 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090303 Aug 02 10:48:58.382592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1028/2651] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:58.571830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:58.572376 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:58.579595 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:58.580041 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:58.580798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:58.581230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:58.585103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:58.936358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:58.944557 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-579ca4f0-8b3f-4040-820f-98fa45b2351c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.376682 Aug 02 10:48:58.945125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1624/2652] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:59.406390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:59.407093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:59.413910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:59.414360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:59.415135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:59.415598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:59.478963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:59.487447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:59.488973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:48:59.490109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b6df556-dbc7-4182-924c-6fc30888d568 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088316 Aug 02 10:48:59.490661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1029/2653] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:48:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:59.965725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:59.966292 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:48:59.972995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:59.973508 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:48:59.974289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:48:59.974731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:00.104535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:00.113107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-efdaef52-ef1f-4623-a7c1-a4f5a4f77428 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151452 Aug 02 10:49:00.113672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1625/2654] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:48:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:00.512743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:00.513386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:00.519974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:00.520417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:00.521181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:00.521648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:00.582078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:00.590441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:00.592501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:00.593650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-779f1232-e03d-440d-a7a2-cb127aeab321 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085103 Aug 02 10:49:00.594201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1030/2655] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:01.134418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:01.135015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:01.141594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:01.142037 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:01.142802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:01.143274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:01.273476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:01.282174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-adb88892-166e-4064-a708-dfa5d800dc10 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151959 Aug 02 10:49:01.282744 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1626/2656] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:01.617730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:01.618338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:01.624895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:01.625340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:01.626098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:01.626528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:01.692155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:01.701965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:01.703570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:01.704732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c3ceed5-4c95-45e1-a740-1d221fd07b78 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091098 Aug 02 10:49:01.705293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1031/2657] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:02.304076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:02.304805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:02.312079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:02.312533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:02.313317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:02.313754 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:02.446472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:02.454549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b9c23baa-44c2-4b09-91c1-b5be531add1a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154486 Aug 02 10:49:02.455117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1627/2658] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:02.728258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:02.728794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:02.736143 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:02.736586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:02.737352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:02.737787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:02.801055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:02.809478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:02.811000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:02.812174 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f3834fc-97d5-43aa-8794-485d98269de9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087917 Aug 02 10:49:02.812727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1032/2659] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:03.476357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:03.476986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:03.483771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:03.484218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:03.484986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:03.485417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:03.616833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:03.625332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ea2753ee-0b4d-45ad-a972-59b6e6cf0b84 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153111 Aug 02 10:49:03.625906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1628/2660] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:03.834279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:03.834895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:03.841746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:03.842193 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:03.842965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:03.843440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:03.905764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:03.914606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:03.916169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:03.917376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7c83b9cc-8612-438d-8355-5eb46fdfa402 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087199 Aug 02 10:49:03.917968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1033/2661] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:04.647201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:04.647833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:04.654414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:04.654863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:04.655664 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:04.656104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:04.783688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:04.791581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9cd7048a-f574-4d7a-a623-3570bfeef22c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148268 Aug 02 10:49:04.792154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1629/2662] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:04 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:04.941852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:04.942446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:04.949052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:04.949505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:04.950269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:04.950747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:05.019864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:05.028850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:05.030991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:05.032354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d1300cb3-2446-4475-b76c-b9ba77e9cea1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094584 Aug 02 10:49:05.032997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1034/2663] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:05.813985 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:05.814592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:05.821011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:05.821453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:05.822211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:05.822645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:05.961716 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:05.969734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a3064b3d-4b99-4830-a950-e8e4f767ef6b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160352 Aug 02 10:49:05.970298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1630/2664] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:06.056514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:06.057275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:06.064972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:06.065339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:06.066125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:06.066556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:06.131597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:06.140729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:06.142274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:06.143499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be5dbcda-e171-4463-b4a1-dd57b033ffa3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091223 Aug 02 10:49:06.144062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1035/2665] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:06.990756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:06.992234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:06.998749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:06.999211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:06.999983 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:07.000410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:07.145712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:07.153945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e58ce105-beab-475a-ad4f-54aa78dd5d13 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167074 Aug 02 10:49:07.154537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1631/2666] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:07.166524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:07.167388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:07.174628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:07.175135 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:07.176220 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:07.176880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:07.246538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:07.255701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:07.257235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:07.258416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-399117a5-af3d-4ddc-b968-d387edc02c95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.096056 Aug 02 10:49:07.259306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1036/2667] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:08.175501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:08.176268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:08.183466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:08.184496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:08.185084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:08.189181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:08.281281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:08.281996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:08.288983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:08.289439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:08.290287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:08.290726 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:08.354898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:08.359380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:08.363964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f1c90280-f185-46bc-bde8-b8eb6ff07875 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.192540 Aug 02 10:49:08.364574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1632/2668] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:08.368478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:08.370052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:08.371209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04ade61c-0eba-4ab6-835a-a46936a19d67 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093890 Aug 02 10:49:08.371754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1037/2669] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:09.387696 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:09.388981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:09.396665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:09.397119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:09.397892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:09.398332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:09.398583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:09.399286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:09.408121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:09.408574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:09.409385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:09.409819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:09.479546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:09.496018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:09.499760 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:09.501949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6f5b08fd-570c-42b0-b1b7-e5bdbc09d2b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.110007 Aug 02 10:49:09.503008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1038/2670] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:09.550053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:09.561601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6a2cc77-212b-42ad-80aa-36b0f4706582 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.178887 Aug 02 10:49:09.562178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1633/2671] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:10.527244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:10.527886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:10.536060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:10.536910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:10.537822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:10.538244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:10.592919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:10.593536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:10.596255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=54 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:10.602356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:10.603024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:10.604230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:10.604748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:10.610199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:10.620046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:10.621644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:10.623391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-44423fe3-4cbf-4ac2-8115-b3f793666eae tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.100335 Aug 02 10:49:10.624124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1039/2672] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:10.763122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:10.775947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-06fbff45-03c4-485a-b216-02ef0de6403b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.188333 Aug 02 10:49:10.776580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1634/2673] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:11.656355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:11.656977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:11.669444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:11.670718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:11.672082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:11.673066 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:11.770543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:11.774902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:11.781292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:11.789026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:11.789026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0289221f-f73b-41c4-beb4-fabf1ec934ee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.131759 Aug 02 10:49:11.789026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1040/2674] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:11.803776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:11.804422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:11.811063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:11.811545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:11.812319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:11.812755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:11.947479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:11.955798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9be5ac6e-9bdb-4697-9817-31ec296cd2f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156017 Aug 02 10:49:11.956383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1635/2675] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:12.809395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.809969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:12.817596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:12.818048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:12.818961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:12.819491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:12.882483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:12.892082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:12.893605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:12.894954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cf98d33c-165e-4f0b-a1f8-bf1526a9e909 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090714 Aug 02 10:49:12.895582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1041/2676] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:12.977847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.978446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:12.986687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:12.987141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:12.987966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:12.988402 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:13.120072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:13.130203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-481527bb-6e7c-4163-8a9a-e24dbe9298d5 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156266 Aug 02 10:49:13.130866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1636/2677] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:13.917864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:13.918547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:13.925170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:13.925617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:13.926515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:13.926957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:13.995113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:14.005837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:14.007818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:14.009013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fde0623e-8cf4-44ed-be2e-1e73b3646f66 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.095196 Aug 02 10:49:14.009869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1042/2678] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:14.151986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:14.152588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:14.159421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:14.159867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:14.160670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:14.161081 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:14.296135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:14.304467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-25cc45eb-80ea-4c75-9e95-a1b449bf476a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156590 Aug 02 10:49:14.305083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1637/2679] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:15.033593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:15.034239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:15.041147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:15.041652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:15.046539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:15.046539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:15.109038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:15.118467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:15.120153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:15.121320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0408a100-7a3e-4142-9e0d-f4e463614519 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092432 Aug 02 10:49:15.121883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1043/2680] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:15.327608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:15.328198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:15.334578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:15.335014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:15.335835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:15.336296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:15.476641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:15.485427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a5dc8411-1f59-475e-885b-3475724d8f7c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.162441 Aug 02 10:49:15.486029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1638/2681] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:16.145443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:16.146163 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:16.153611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:16.154618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:16.155451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:16.155927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:16.227423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:16.237385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:16.239234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:16.240422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-447d43fe-a8e6-4a1c-8019-16d0ba48741c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.099079 Aug 02 10:49:16.240970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1044/2682] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:16.510896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:16.510896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:16.517272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:16.517835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:16.518725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:16.519269 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:16.671556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:16.679970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-238bdef2-fefd-4c42-85fc-bd835e64d819 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.176158 Aug 02 10:49:16.680550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1639/2683] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:17.270225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:17.270865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:17.273418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=54 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:17.278508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:17.279534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:17.280354 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:17.280790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:17.348464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:17.357661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:17.359258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:17.360508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9690976a-b452-4b73-adc3-ea1d30981f17 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094361 Aug 02 10:49:17.361082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1045/2684] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:17.704312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:17.704312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:17.711438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:17.711885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:17.712702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:17.713135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:17.882534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:17.886628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:17.893051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-08a96cac-91ec-4abc-8ab7-76b0072b3382 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.193356 Aug 02 10:49:17.893723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1640/2685] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:18.387628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:18.388265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:18.395520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:18.395969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:18.396767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:18.397242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:18.464793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:18.474897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:18.476430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:18.477645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2fa34460-99a9-4384-bd2d-8c25af191c07 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094526 Aug 02 10:49:18.478198 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1046/2686] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:18.930314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:18.930971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:18.938087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:18.938536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:18.939342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:18.939780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:19.081228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:19.089459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ca6bbfec-1e53-4e07-bec6-70fd27c05fb3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163516 Aug 02 10:49:19.090045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1641/2687] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:19.502019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:19.502683 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:19.509817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:19.510284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:19.511064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:19.511528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:19.578929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:19.588092 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:19.589622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:19.590802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9769f86-6513-4d36-81a1-304b4bf64bf2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093362 Aug 02 10:49:19.591425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1047/2688] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:20.115549 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:20.116170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:20.123162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:20.123638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:20.124426 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:20.124860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:20.271904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:20.284950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eed3685d-2774-4f35-b88c-5941c54a2591 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.173993 Aug 02 10:49:20.285618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1642/2689] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:20.614140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:20.614766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:20.621374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:20.621818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:20.622587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:20.623017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:20.690079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:20.698764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:20.700396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:20.702199 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f0e4f9f-032c-4d71-9a0a-5260463ccfe2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092273 Aug 02 10:49:20.702765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1048/2690] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:21.306974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:21.307616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:21.315120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:21.315608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:21.316383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:21.316821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:21.452492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:21.460880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2829330b-03ce-458d-8dc9-2308785234bb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157819 Aug 02 10:49:21.461488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1643/2691] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:21.727404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:21.728022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:21.738997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:21.739470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:21.740258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:21.740694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:21.832497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:21.848620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:21.851709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:21.854095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34959c8d-39fc-4c2f-ba3b-6f1e29210244 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.132596 Aug 02 10:49:21.855911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1049/2692] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:22.483242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:22.484685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:22.494185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:22.494811 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:22.495470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:22.495927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:22.656408 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:22.667097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6f670726-3b7b-4207-91c5-868f3caf10d0 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.187782 Aug 02 10:49:22.668194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1644/2693] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:22.878522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:22.879353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:22.886459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:22.886905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:22.887734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:22.888175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:22.957965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:22.969728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:22.971337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:22.972536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee8b8088-98a6-4678-9c96-49c5446e6570 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.098755 Aug 02 10:49:22.973089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1050/2694] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:23.692477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:23.693110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:23.699880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:23.700321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:23.701106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:23.701561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:23.845819 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:23.854541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5738c9e-c90a-4a7c-bf09-7971f7ee3686 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165906 Aug 02 10:49:23.855130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1645/2695] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:23.995825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:23.996421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:24.003288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:24.003786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:24.004575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:24.005015 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:24.070828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:24.083126 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:24.085004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:24.086170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a01bdac4-67fc-41f8-a18b-5c078fb37342 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094453 Aug 02 10:49:24.086864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1051/2696] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:23 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:24.877713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:24.878314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:24.885387 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:24.885824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:24.886594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:24.887061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:25.034906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:25.043374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5b86871d-ead1-4c2f-a346-cf4558874774 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170135 Aug 02 10:49:25.043946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1646/2697] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:24 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:25.109689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:25.110362 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:25.117725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:25.123612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:25.123612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:25.123612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:25.188870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:25.197800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:25.199386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:25.200584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-da027ef4-e1f2-44f6-81dc-aeeca4f7ee86 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.095521 Aug 02 10:49:25.201178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1052/2698] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:26.066717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:26.067440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:26.075178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:26.075777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:26.077504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:26.078155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:26.219261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:26.222949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:26.223593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:26.227476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2b775c6a-c697-4f02-9ba7-c257092eaa63 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165361 Aug 02 10:49:26.228286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1647/2699] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:26.229914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:26.229914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:26.231073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:26.231597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:26.293905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:26.303243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:26.304771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:26.305928 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c1e1567-fbbb-4e88-8995-77e17d8816b3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086762 Aug 02 10:49:26.306545 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1053/2700] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:27.249233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:27.249850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:27.256413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:27.256862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:27.257622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:27.258063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:27.329699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:27.330457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:27.337079 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:27.337544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:27.338342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:27.338843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:27.393416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:27.401528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6b1979af-649b-4a89-a394-ee4c979a1138 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156739 Aug 02 10:49:27.402111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1648/2701] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:27.402814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:27.413132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:27.414824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:27.416074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cf719778-bef7-4bce-934b-21a24a1afe34 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090827 Aug 02 10:49:27.416697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1054/2702] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:28.425412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:28.425986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:28.433633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:28.434088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:28.434893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:28.435885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:28.438631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:28.439278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:28.445806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:28.446249 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:28.447019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:28.447489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:28.516201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:28.525576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:28.527129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:28.528311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db134ded-537e-422a-8a4d-982baee8f72f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094317 Aug 02 10:49:28.543390 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1055/2703] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:28.585846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:28.594555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cab67b30-cdbd-4680-a794-241f79dc5a78 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.175150 Aug 02 10:49:28.595129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1649/2704] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:29.552345 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:29.552973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:29.559758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:29.560241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:29.561012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:29.561476 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:29.616718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:29.618045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:29.624236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:29.624690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:29.625876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:29.625876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:29.628827 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:29.639212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:29.640773 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:29.641948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5ecec132-6b02-452b-90f2-9f80d7e670e2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093577 Aug 02 10:49:29.642885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1056/2705] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:29.761869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:29.770884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-95e32f79-795b-438c-a11c-6378e59c6fa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158000 Aug 02 10:49:29.771509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1650/2706] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:30.665774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:30.666486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:30.674370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:30.674815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:30.675618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:30.676052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:30.696059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:30.742606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:30.751237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:30.752823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:30.753969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6700d6ca-3ab0-40d1-87ee-9ae2e5f91bb0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092166 Aug 02 10:49:30.754523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1057/2707] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:30.793842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:30.795604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:30.802431 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:30.802923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:30.803745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:30.804177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:30.936120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:30.944106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c42e0be1-0c52-44a4-983d-f1a4cdf5f9b6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155028 Aug 02 10:49:30.944671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1651/2708] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:30 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:31.776778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:31.777672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:31.784879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:31.785235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:31.786017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:31.786443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:31.849803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:31.860641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:31.862061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:31.863247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d085b801-ef88-4163-ae8c-b144da1fd1eb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090405 Aug 02 10:49:31.863832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1058/2709] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:31.967542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:31.968071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:31.975005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:31.975532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:31.976430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:31.977318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:32.141997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:32.156530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-38d22bb2-528c-49a3-8c4d-931be6e25a47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.193637 Aug 02 10:49:32.157941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1652/2710] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:32.887369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:32.887995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:32.895482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:32.895955 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:32.896720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:32.897158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:32.963813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:32.972490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:32.974294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:32.975763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-74f339dc-45fe-4bed-abe2-b150f067ef53 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093596 Aug 02 10:49:32.976346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1059/2711] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:33.183369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:33.183953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:33.191014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:33.191493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:33.192272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:33.192709 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:33.329510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:33.338916 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-da0f1522-adf7-4afb-b84b-5ea3bd4ea2a8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160295 Aug 02 10:49:33.339524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1653/2712] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:34.000632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:34.001254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:34.008175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:34.008632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:34.009407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:34.010101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:34.084533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:34.094112 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:34.095664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:34.096819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ba544c6-e736-4825-b470-83b66b8aede8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.100797 Aug 02 10:49:34.097487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1060/2713] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:33 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:34.362594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:34.363234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:34.370619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:34.371087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:34.371977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:34.372435 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:34.521791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:34.533176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4490231c-f862-48cc-8dbe-9d70fd2d985c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.174575 Aug 02 10:49:34.533771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1654/2714] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:35.120850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:35.121509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:35.128762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:35.130990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:35.130990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:35.132044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:35.197651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:35.208073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:35.209621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:35.210789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee611779-0992-44bf-b7b3-87727ef3e74f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094098 Aug 02 10:49:35.211366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1061/2715] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:35.554560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:35.555458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:35.562987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:35.565568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:35.565568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:35.565568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:35.707289 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:35.716562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5a529b5c-ef8e-47be-ab80-72ada2598061 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166019 Aug 02 10:49:35.717148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1655/2716] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:35.963733 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:49:35.964127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:49:36.235685 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:36.236501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:36.243072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:36.243557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:36.244331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:36.244765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:36.315789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:36.324646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:36.326675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:36.327873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5f615c9a-4c38-41d3-a850-0f14b1eadf47 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.097072 Aug 02 10:49:36.328431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1062/2717] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:36.744984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:36.745620 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:36.752513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:36.752962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:36.753810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:36.754250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:36.939151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:36.947531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb7ff39e-95e6-4278-a512-8f601fdb35a9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.209342 Aug 02 10:49:36.948111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1656/2718] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:37.353786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:37.354641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:37.361548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:37.361988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:37.362829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:37.363282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:37.429388 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:37.441158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:37.442690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:37.443900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a3a20024-337d-47b9-8270-2b7c627af15c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094790 Aug 02 10:49:37.444488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1063/2719] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:37.969978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:37.970718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:37.977472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:37.977912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:37.978688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:37.979126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:37.998940 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:38.126410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:38.134446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c3fc2547-ae4b-4d6b-b04a-39c4aa22ff47 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.168986 Aug 02 10:49:38.135420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1657/2720] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:37 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:38.470549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:38.471161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:38.477874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:38.478333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:38.479830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:38.480325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:38.557525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:38.569356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:38.571080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:38.572305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-def9542e-7ca9-4fcd-987d-b9aef0b5d1bd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.106484 Aug 02 10:49:38.572946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1064/2721] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:39.158544 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:39.159139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:39.166498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:39.167230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:39.168310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:39.168855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:39.308840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:39.317065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-73b9a97f-7687-4730-9362-7917acc09900 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163102 Aug 02 10:49:39.317638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1658/2722] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:39.596060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:39.597934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:39.604960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:39.605402 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:39.606156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:39.606585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:39.670889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:39.679661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:39.681219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:39.682417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6840185d-658a-4a73-abc2-ed559a394f68 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090960 Aug 02 10:49:39.682993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1065/2723] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:40.338183 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:40.338781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:40.345366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:40.345825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:40.346581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:40.347016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:40.484282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:40.492472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e04e1583-5abb-42de-b6e1-4cfd223626e1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158202 Aug 02 10:49:40.493065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1659/2724] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:40.706085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:40.706655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:40.713481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:40.713924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:40.714718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:40.715148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:40.778947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:40.788196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:40.789755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:40.790903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c1ff6f5-e429-429e-814f-6e8a54b7bcdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088870 Aug 02 10:49:40.791491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1066/2725] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:41.514598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:41.515238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:41.517625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:41.522963 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:41.523456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:41.524232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:41.524675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:41.659074 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:41.666989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-052e5ce9-0bfb-437c-84c7-75ec635f5010 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156725 Aug 02 10:49:41.667615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1660/2726] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:41.813321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:41.814205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:41.821842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:41.822290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:41.823110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:41.823712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:41.890768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:41.901108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:41.902642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:41.904369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ff085f52-8855-40d3-a042-ff4255790f40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.095105 Aug 02 10:49:41.904926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1067/2727] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:42.688992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:42.689639 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:42.696170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:42.696691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:42.697456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:42.697888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:42.835570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:42.843626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c81a6155-aa77-49ad-9c87-ed0b1095c5f2 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158963 Aug 02 10:49:42.844201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1661/2728] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:42.927516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:42.928125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:42.934921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:42.935958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:42.936757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:42.937232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:43.004286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:43.013581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:43.015096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:43.016278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-982a5cdd-cd45-4c37-8e41-1651fc1b8e73 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093613 Aug 02 10:49:43.016834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1068/2729] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:42 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:43.865299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:43.865863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:43.872403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:43.872844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:43.873594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:43.874029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:44.014132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:44.023178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4daa8dd4-2da5-4e9e-ac6a-fb773980dc24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161673 Aug 02 10:49:44.023799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1662/2730] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:43 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:44.038148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:44.038950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:44.045598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:44.046045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:44.046813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:44.047269 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:44.109341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:44.117723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:44.119235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:44.120370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8866ca65-5e2b-46a7-9704-5c680eca0d75 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086311 Aug 02 10:49:44.120919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1069/2731] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:45.045647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:45.046319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:45.052411 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:45.052852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:45.053614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:45.054044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:45.143290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:45.143939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:45.151963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:45.152439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:45.153242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:45.153673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:45.194063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:45.203599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d5e1fb02-549a-42b7-94aa-8f376ea2ab4f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161868 Aug 02 10:49:45.204278 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1663/2732] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:45.221529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:45.230604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:45.232471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:45.234691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d56fd4b4-667f-48eb-8b0c-28421717a618 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094162 Aug 02 10:49:45.234691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1070/2733] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:46.231481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:46.232077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:46.239121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:46.239723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:46.240488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:46.240921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:46.258673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:46.259414 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:46.267487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:46.267954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:46.269236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:46.269834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:46.336122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:46.345767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:46.347435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:46.348630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8056114a-d15d-4f70-9008-bbfc71eac2e3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.094841 Aug 02 10:49:46.349946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1071/2734] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:49:46.382200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:46.391502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c3a0688-00e1-4efb-8c65-273b7a7e93b7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163694 Aug 02 10:49:46.392231 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1664/2735] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:47.371695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:47.372404 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:47.374675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=54 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:47.379606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:47.380055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:47.380820 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:47.381254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:47.412599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:47.413867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:47.421984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:47.422533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:47.423020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:47.423489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:47.450073 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:47.467681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:47.470399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:47.472680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cf294d42-08de-4d63-aabd-b11d61d29a88 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.104618 Aug 02 10:49:47.473913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1072/2736] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:47.560584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:47.568962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-30e737da-9a77-4383-858e-5e2e923489ae tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160382 Aug 02 10:49:47.569528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1665/2737] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:48.496254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:48.496907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:48.503861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:48.504335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:48.505114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:48.505547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:48.576056 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:48.586822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:48.588419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:48.589607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f30ab7aa-4654-4930-916b-a76eb5cad497 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.097402 Aug 02 10:49:48.590164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1073/2738] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:48.594023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:48.594637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:48.601636 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:48.602246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:48.603147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:48.603719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:48.744004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:48.752673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4a492584-a817-497b-9e32-590a51362f3a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164246 Aug 02 10:49:48.753273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1666/2739] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:49.616349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:49.616999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:49.624653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:49.625098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:49.625878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:49.626315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:49.630845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:49.691652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:49.700784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:49.702909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:49.704119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8aacc66a-6295-4f4c-a349-71cedf71856f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091982 Aug 02 10:49:49.704698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1074/2740] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:49.775610 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:49.776222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:49.783425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:49.783876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:49.784719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:49.785088 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:49.918561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:49.927848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6fff04d8-f120-45e8-b1c6-0f1f4796724c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156049 Aug 02 10:49:49.928246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1667/2741] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:50.726719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:50.727341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:50.735038 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:50.735515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:50.736307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:50.736742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:50.800797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:50.809891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:50.812018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:50.813221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c04de586-4eee-4d17-9227-c8b6465cd929 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090526 Aug 02 10:49:50.813774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1075/2742] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:50.956703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:50.957315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:50.964631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:50.965087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:50.965890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:50.966327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:51.101030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:51.109796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83ce0447-c44b-478c-a0aa-1b9022c9cab3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157096 Aug 02 10:49:51.110370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1668/2743] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:50 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:51.836435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:51.836979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:51.843564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:51.844006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:51.844832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:51.845258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:51.909061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:51.917857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:51.919465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:51.920693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e3facc3d-6a5a-4d90-8573-928c48260d40 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088506 Aug 02 10:49:51.921248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1076/2744] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:52.131817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:52.132475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:52.140102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:52.140559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:52.141338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:52.141777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:52.284862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:52.292833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0064d411-12eb-4fb5-9b48-3198b4135ef3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165051 Aug 02 10:49:52.293396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1669/2745] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:52.942902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:52.943498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:52.949968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:52.950408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:52.951155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:52.951616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:53.014065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:53.023525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:53.025074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:53.026216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2a99911c-6821-4bd4-b984-a9adf8d8cb59 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087421 Aug 02 10:49:53.026887 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1077/2746] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:53.314858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:53.315513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:53.322349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:53.322873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:53.323760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:53.324225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:53.458098 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:53.466728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6f07073d-d02a-48cb-9e78-640f1984e785 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156379 Aug 02 10:49:53.467375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1670/2747] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:54.054541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:54.055140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:54.061248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:54.061689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:54.062439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:54.062867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:54.122790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:54.131446 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:54.132951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:54.134081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b66be64-3ce2-492e-ac48-f6abfe1fb12e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.083646 Aug 02 10:49:54.134630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1078/2748] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:54.488428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:54.489101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:54.495986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:54.496434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:54.497204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:54.497638 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:54.637397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:54.645906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2bf0fef8-51fc-405f-b71d-9fcf986875bf tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161459 Aug 02 10:49:54.646465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1671/2749] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:55.156814 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:55.157422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:55.164024 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:55.164465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:55.165209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:55.165636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:55.232544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:55.241421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:55.242954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:55.244140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89d209be-c6a7-40fb-b3a7-e4ebd0408fdd tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091236 Aug 02 10:49:55.244699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1079/2750] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:55.667662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:55.668384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:55.675738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:55.676181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:55.676946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:55.677373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:55.809029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:55.817805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d10a5dd4-f069-4ffd-a65a-ac1657162c39 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153957 Aug 02 10:49:55.818396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1672/2751] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:56.268142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:56.268753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:56.275449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:56.275889 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:56.276651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:56.277082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:56.343077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:56.351812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:56.353326 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:56.354466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a2a0eb3f-b768-4952-9a60-cebc72fd0a95 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090951 Aug 02 10:49:56.355018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1080/2752] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:56.838382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:56.838981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:56.847543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:56.847991 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:56.851226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:56.851226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:56.991293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:56.999325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b55cb88d-17a5-410e-863a-b0a2b2aea0ed tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.164872 Aug 02 10:49:56.999892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1673/2753] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:57.378325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:57.378952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:57.385756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:57.386214 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:57.386968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:57.387428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:57.449049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:57.457828 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:57.459367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:57.460547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e1260bf-3251-4078-9182-e8d3a4bbca80 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086692 Aug 02 10:49:57.461083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1081/2754] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:58.021262 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:58.021878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:58.028633 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:58.029080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:58.029852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:58.030286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:58.035085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:58.165789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:58.173878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a169148b-28f8-4dbc-84d0-8926491fcb4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156476 Aug 02 10:49:58.174447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1674/2755] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:58.482997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:58.483597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:58.490501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:58.490938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:58.491713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:58.492142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:58.553991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:58.562338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:58.563874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:58.564994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63d90bba-e05c-496d-8109-c33bcb6bce97 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086037 Aug 02 10:49:58.565544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1082/2756] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:59.195342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:59.195953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:59.202727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:59.203175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:59.204464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:59.204908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:59.334576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:59.343955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b6a74c42-6a10-4cd5-bdd7-1dc01b200e37 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152545 Aug 02 10:49:59.344520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1675/2757] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:49:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:59.588375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:59.588979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:49:59.596173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:59.596610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:59.597360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:49:59.597784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:49:59.660208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:59.668736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:59.670238 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:49:59.671401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c71feebb-ee93-4ea5-946d-3728eeb68950 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087050 Aug 02 10:49:59.671946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1083/2758] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:49:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:00.365618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:00.366264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:00.373230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:00.373672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:00.374472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:00.374910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:00.508577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:00.517032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-004979ba-85fb-413d-a766-cdb0daed02e8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155342 Aug 02 10:50:00.517601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1676/2759] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:00.693876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:00.694439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:00.700944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:00.701392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:00.702155 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:00.702586 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:00.767397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:00.775908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:00.777430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:00.778571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a38ba08c-4ee8-4c7b-b007-d6f9d3d7aa5a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088756 Aug 02 10:50:00.779130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1084/2760] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:00 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:01.539416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:01.540019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:01.546707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:01.547142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:01.548548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:01.548978 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:01.677820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:01.685812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3c76d52b-e221-4937-82a9-765eebc0cfa3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150884 Aug 02 10:50:01.686374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1677/2761] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:01.801713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:01.802254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:01.809019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:01.809464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:01.810241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:01.810672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:01.870640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:01.879063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:01.880611 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:01.881744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee71152d-d549-43b8-847b-c7689c98971f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.084724 Aug 02 10:50:01.882296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1085/2762] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:02.707708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:02.708335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:02.715079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:02.715560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:02.716340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:02.716778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:02.854561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:02.863135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cd9654a7-1371-46d0-9ce8-d12b2848d76b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159746 Aug 02 10:50:02.863738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1678/2763] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:02.904852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:02.905457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:02.912149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:02.912696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:02.913463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:02.913870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:02.977343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:02.985833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:02.987931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:02.989078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd905fa5-9e6d-4ee3-8108-e2a3c03fcb61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088182 Aug 02 10:50:02.989639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1086/2764] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:03.885348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:03.886177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:03.893603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:03.894044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:03.894807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:03.895318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:04.011853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:04.012474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:04.021258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:04.021613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:04.022200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:04.022632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:04.044343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:04.052873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4676055b-326f-4f7c-b671-ec11364daa08 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.171460 Aug 02 10:50:04.053462 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1679/2765] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:04.089228 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:04.098286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:04.099961 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:04.101136 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-42b6e66c-1472-4ed7-8f2e-703c5ce3cdca tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093620 Aug 02 10:50:04.101696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1087/2766] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:05.074984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:05.078675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:05.082048 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:05.082503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:05.083309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:05.083776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:05.125645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:05.126465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:05.133682 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:05.134128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:05.134908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:05.135811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:05.202802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:05.211937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:05.215925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:05.216623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:05.217129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed73cd3c-4641-4219-b9e8-ac927f2b8ba0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.095556 Aug 02 10:50:05.217694 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1088/2767] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:05.225198 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-18a9164e-0134-48ae-9238-8eff692cc193 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155000 Aug 02 10:50:05.225769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1680/2768] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:06.240978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:06.241837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:06.246743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:06.247485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:06.248749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:06.249192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:06.249993 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:06.250428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:06.254144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:06.254594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:06.255397 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:06.255850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:06.315242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:06.323932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:06.325464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:06.326620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d3287ea-a2ce-469f-b9f3-2dc126362da7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090235 Aug 02 10:50:06.327179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1089/2769] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:06.392135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:06.400314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-67666efd-f5da-461a-ab6f-9b2fcf7bb9d7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157943 Aug 02 10:50:06.400889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1681/2770] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:07.349988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:07.350635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:07.357474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:07.357979 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:07.358758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:07.359202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:07.420300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:07.421742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:07.422361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:07.423936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:07.429313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:07.429765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:07.430560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:07.430686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:07.431009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:07.432227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:07.437872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-afacd2a4-d2e3-4836-8b37-0fb304ca2476 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087484 Aug 02 10:50:07.437872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1090/2771] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:07.562449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:07.570597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6e20178-63e8-4dcb-806c-3c64439cce24 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152618 Aug 02 10:50:07.571168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1682/2772] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:08.457084 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:08.457643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:08.464262 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:08.464704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:08.465457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:08.465891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:08.527525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:08.536905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:08.538442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:08.540570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-efa7360d-d1bc-4571-b95d-cfba2269c159 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087689 Aug 02 10:50:08.541385 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1091/2773] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:08.591301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:08.591929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:08.599165 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:08.599631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:08.600391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:08.600824 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:08.733801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:08.741935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3b20a560-7778-43cd-909a-bbd1254345b3 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154630 Aug 02 10:50:08.742489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1683/2774] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:09.565182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:09.566380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:09.572958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:09.573395 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:09.574145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:09.574569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:09.643260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:09.652016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:09.653509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:09.654666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04f3de61-0f65-4d10-a2e3-5295a03365ed tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093571 Aug 02 10:50:09.655240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1092/2775] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:09.763561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:09.764173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:09.770880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:09.771361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:09.772122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:09.772545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:09.903091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:09.912206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bd3718f0-8c77-4ad8-b345-eca83741c611 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152843 Aug 02 10:50:09.914569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1684/2776] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:10.676833 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:10.677514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:10.684095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:10.684540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:10.685298 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:10.685734 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:10.745687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:10.754658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:10.757902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:10.759057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c81e68f-32aa-4985-a51a-4450d95fc6ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086210 Aug 02 10:50:10.759662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1093/2777] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:10 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:10.934174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:10.934751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:10.942373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:10.942822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:10.943662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:10.944095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:11.074899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:11.083044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f720fa01-c2ca-4408-81b1-f4d5a813f874 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152893 Aug 02 10:50:11.083656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1685/2778] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:10 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:11.782352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:11.783010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:11.790363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:11.790808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:11.791614 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:11.792045 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:11.857237 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:11.866477 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:11.868121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:11.869320 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe932e9f-0f91-4323-8a7c-8b55320f182c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091034 Aug 02 10:50:11.869886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1094/2779] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:12.103863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:12.104515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:12.107070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:12.112044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:12.112497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:12.113261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:12.113755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:12.257958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:12.269630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d9d26403-439c-485e-81db-4baafe7c790f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.168605 Aug 02 10:50:12.270699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1686/2780] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:12.892549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:12.893123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:12.900116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:12.900582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:12.901480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:12.901907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:12.963802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:12.972978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:12.974486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:12.975753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ab147b3d-067c-4c4a-9d6d-59680a41130f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087324 Aug 02 10:50:12.976296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1095/2781] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:13.292854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:13.293512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:13.300352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:13.300809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:13.301584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:13.302020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:13.430850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:13.439686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6035967f-470d-43c8-bca8-33e148618e73 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150974 Aug 02 10:50:13.440257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1687/2782] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:13.998764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:13.999411 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:14.006832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:14.007304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:14.008062 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:14.008541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:14.077054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:14.085911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:14.087479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:14.088656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e476de16-d934-480a-982c-0bad07ae5d5c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093818 Aug 02 10:50:14.089209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1096/2783] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:14.463176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:14.463776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:14.473727 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:14.474177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:14.475103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:14.475575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:14.622820 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:14.630801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d1a6d87-eb3d-4db0-ae24-0c3fb1caf7f8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.172471 Aug 02 10:50:14.631425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1688/2784] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:15.111635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:15.112276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:15.119631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:15.120077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:15.120846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:15.121277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:15.189025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:15.198405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:15.199992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:15.201141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3af822eb-47f5-49d8-9572-b0c063a3174b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093796 Aug 02 10:50:15.201696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1097/2785] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:15.652703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:15.653375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:15.661181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:15.661474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:15.662252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:15.662693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:15.802944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:15.811160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-67ae8b6a-7b0f-49a5-b46d-d72de0fca892 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.162473 Aug 02 10:50:15.811775 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1689/2786] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:15 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:16.233621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:16.234292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:16.241847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:16.242291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:16.243099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:16.243563 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:16.309207 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:16.319109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:16.320706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:16.321904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34733f4e-ef18-49d8-b60e-9d46d61feac7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092428 Aug 02 10:50:16.322475 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1098/2787] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:16.833275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:16.833832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:16.840406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:16.843715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:16.843715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:16.843715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:16.985493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:16.989515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:16.994392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bbe66c53-1662-4652-af5c-04d1112d1438 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165641 Aug 02 10:50:16.998291 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1690/2788] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:17.345059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:17.345701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:17.353037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:17.353483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:17.354256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:17.354692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:17.421393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:17.428534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:17.430065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:17.431215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d81a8fff-d886-4917-a5e2-921f9503f31a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090068 Aug 02 10:50:17.431869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1099/2789] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:18.018258 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:18.019496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:18.029503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:18.029952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:18.030731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:18.031168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:18.167427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:18.175948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e7cedaea-232c-4305-90a8-de4ad5550f50 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161696 Aug 02 10:50:18.176542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1691/2790] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:18.454309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:18.454890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:18.457335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=56 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:18.462600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:18.473134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:18.473134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:18.473134 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:18.534713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:18.543680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:18.545223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:18.546356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-07e6e7fc-89dc-4cb4-9bf1-a9a259cb78b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.096169 Aug 02 10:50:18.546905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1100/2791] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:19.198948 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:19.199660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:19.206236 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:19.206684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:19.208007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:19.208440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:19.342053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:19.350712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1813ae4e-a1dc-407e-8953-24bd99380e8f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155797 Aug 02 10:50:19.351563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1692/2792] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:19.570102 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:19.570715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:19.577571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:19.578017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:19.578793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:19.579247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:19.641845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:19.651431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:19.652958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:19.654144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed3a765c-67a2-48a3-a59f-5ba4466c3dee tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088763 Aug 02 10:50:19.654708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1101/2793] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:20.372406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:20.373033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:20.380023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:20.380465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:20.381225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:20.381652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:20.521479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:20.535516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b56f5064-7eb4-4ba3-b0cb-dea4b9b0e97e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.166914 Aug 02 10:50:20.536129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1693/2794] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:20.678152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:20.678728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:20.685605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:20.686037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:20.686810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:20.687268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:20.755110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:20.764261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:20.765782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:20.766940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8288f90c-0193-47a6-aa62-9b681229a7ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093540 Aug 02 10:50:20.767528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1102/2795] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:20 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:21.558066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:21.558721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:21.565613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:21.566063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:21.567489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:21.567929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:21.703326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:21.717759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1c3c4163-ef13-4fe9-a3f4-f87894a34d98 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.163681 Aug 02 10:50:21.718809 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1694/2796] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:21 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:21.792406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:21.793233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:21.800170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:21.800606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:21.802018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:21.802449 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:21.864732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:21.873645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:21.875152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:21.876309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-070f5a1d-06de-4478-b0e8-71d5630e8e4c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.089226 Aug 02 10:50:21.876870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1103/2797] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:21 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:22.740504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:22.741120 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:22.747771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:22.748211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:22.748973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:22.749406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:22.888279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:22.897964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1cc08be7-ebcd-4128-a0d2-f03e00e116cd tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161774 Aug 02 10:50:22.900988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:22.902002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:22.912719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1695/2798] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:22 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:22.914356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:22.914816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:22.915630 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:22.916076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:23.001533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:23.010908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:23.012759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:23.013997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8c9d26d7-2323-4507-be36-b674118bd12f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.117459 Aug 02 10:50:23.014556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1104/2799] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:22 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:23.920759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:23.921356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:23.928596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:23.929061 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:23.929927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:23.930367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:24.038245 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:24.038973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:24.045504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:24.045948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:24.046728 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:24.047156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:24.068999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:24.077383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c71e000b-0663-4740-9cc3-f6871c969de6 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160718 Aug 02 10:50:24.078057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1696/2800] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:23 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:24.118005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:24.127177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:24.128775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:24.130522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-30295fea-e2b5-4f5b-bd6c-657a2d275d15 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.096302 Aug 02 10:50:24.131070 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1105/2801] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:24 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:25.099319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:25.099988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:25.106805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:25.107368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:25.108138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:25.108577 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:25.154648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:25.155283 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:25.162156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:25.162596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:25.163433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:25.163861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:25.232819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:25.246595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:25.249498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:25.251490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-900c4a74-77e0-4d87-a797-ceadc9c4dd61 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.100818 Aug 02 10:50:25.252607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1106/2802] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:25 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:25.267842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:25.282497 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-221e5fa8-0268-4cd5-b038-65e4de80f8d9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.186804 Aug 02 10:50:25.283597 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1697/2803] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:25 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:26.278596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:26.279696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:26.292116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:26.292942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:26.294359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:26.295406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:26.305023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:26.305680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:26.312735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:26.313194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:26.314089 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:26.314516 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:26.329573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:26.382036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:26.392291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:26.394140 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:26.396008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b57a6e8c-3c66-4592-b2c9-3c13576b3cf8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.122905 Aug 02 10:50:26.396568 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1107/2804] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:26 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:26.465281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:26.479729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f5054a78-46a6-45eb-aa24-0c28bc022e0e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.178427 Aug 02 10:50:26.480440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1698/2805] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:26 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:27.418871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:27.419518 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:27.427012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:27.427473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:27.428275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:27.428704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:27.493215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:27.501808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:27.502418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:27.502588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:27.504809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:27.506044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-39af82dc-af42-4ec5-a4f3-4c0a81b42861 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091107 Aug 02 10:50:27.506626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1108/2806] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:27 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:27.512367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:27.512817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:27.513606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:27.514035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:27.650313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:27.658580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-deb9e147-88e4-405c-9c47-d16bfc30733f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160842 Aug 02 10:50:27.659180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1699/2807] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:27 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:28.528998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:28.529591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:28.537036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:28.537488 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:28.538292 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:28.538751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:28.602394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:28.610949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:28.612592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:28.614351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bf34fb85-2e98-48de-89c5-5a43bdf097cb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088844 Aug 02 10:50:28.614914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1109/2808] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:28 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:28.681218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:28.681825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:28.688587 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:28.689373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:28.690148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:28.690589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:28.824531 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:28.833247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-945a7976-4ab3-4c57-be88-e389197dba5a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155973 Aug 02 10:50:28.833814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1700/2809] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:28 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:29.637673 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:29.638341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:29.645210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:29.645652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:29.646412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:29.646840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:29.709276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:29.717795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:29.719356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:29.720528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aa8f5587-cdcc-4c29-8b70-672a242ce72a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087200 Aug 02 10:50:29.721090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1110/2810] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:29 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:29.854665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:29.855232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:29.862206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:29.862648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:29.863952 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:29.864384 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:29.995751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:30.004101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b182df8a-ea4c-4b8b-bcf9-ba2041384e58 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153342 Aug 02 10:50:30.004683 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1701/2811] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:29 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:30.744644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:30.745217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:30.752406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:30.754217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:30.754217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:30.754217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:30.825580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:30.834907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:30.836479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:30.837625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e659add-76b4-416f-95e3-e95213c0c642 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.097056 Aug 02 10:50:30.838188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1111/2812] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:30 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:31.030534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:31.031496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:31.038276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:31.038766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:31.039574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:31.040004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:31.179393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:31.187685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-74c6d276-d4e1-4e04-8ca8-d2db4ce930ef tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161998 Aug 02 10:50:31.188270 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1702/2813] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:31 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:31.860597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:31.861182 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:31.867966 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:31.868418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:31.869189 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:31.869632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:31.936247 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:31.946007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:31.947574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:31.948742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-79304b6e-8c9a-4d70-bfd0-a8bd607ad48f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092309 Aug 02 10:50:31.949303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1112/2814] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:31 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:32.210201 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:32.210865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:32.218062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:32.218514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:32.219325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:32.219756 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:32.362762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:32.370977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e5bfae85-c5ca-457c-af2a-6a8fbeb4e878 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.165414 Aug 02 10:50:32.371592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1703/2815] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:32 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:32.973052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:32.973664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:32.980754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:32.981206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:32.981985 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:32.982420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:33.058098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:33.068343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:33.069873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:33.071039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2895fbc7-c6d6-4a90-8f7c-4d1baa0d4a4a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.102246 Aug 02 10:50:33.071625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1113/2816] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:32 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:33.393393 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:33.394043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:33.401448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:33.401892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:33.402667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:33.403099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:33.542647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:33.551029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-31a17d7a-a5ae-4a06-9655-383f371d3052 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161465 Aug 02 10:50:33.551649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1704/2817] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:33 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:34.095103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:34.097892 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:34.103793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:34.104278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:34.105088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:34.105514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:34.174359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:34.187809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:34.189266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:34.190665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc0a6d42-ac45-47ee-ab1e-ffb1bf8e8088 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.099916 Aug 02 10:50:34.191251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1114/2818] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:34 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:34.574156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:34.574738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:34.581665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:34.582152 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:34.583505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:34.583946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:34.740565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:34.755200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-061caed1-da28-496b-825d-e256a0df2c7a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.184098 Aug 02 10:50:34.756293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1705/2819] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:34 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:35.219908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:35.220569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:35.228098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:35.228540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:35.229516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:35.229765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:35.297018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:35.306708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:35.308393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:35.309552 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd5419bb-7c40-44d9-8707-b2ed193eb20a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.093817 Aug 02 10:50:35.310123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1115/2820] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:35 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:35.777869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:35.778466 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:35.785602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:35.785969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:35.787055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:35.787732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:35.920802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:35.929649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-be449a90-f8ea-46dd-9475-765ee1f4c286 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155822 Aug 02 10:50:35.930483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1706/2821] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:35 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:36.333871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:36.334484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:36.341296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:36.341741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:36.342513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:36.342946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:36.410088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:36.429598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:36.432690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:36.434808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47197a47-238e-42a2-982c-63aa0b4f5e0b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.105193 Aug 02 10:50:36.435845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1116/2822] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:36 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:36.950937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:36.951568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:36.958936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:36.960498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:36.961364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:36.961827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:36.981358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:37.115132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:37.123005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-84e3437d-52c9-4d85-9335-624b946874fb tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.175909 Aug 02 10:50:37.123613 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1707/2823] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:36 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:37.466111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:37.466653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:37.474095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:37.474536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:37.475334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:37.475764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:37.541258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:37.549951 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:37.552119 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:37.553307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ce498d4b-9967-439d-a31c-c2a328cc202a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091329 Aug 02 10:50:37.553869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1117/2824] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:37 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:38.147580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:38.148688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:38.157459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:38.157907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:38.158692 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:38.159130 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:38.303507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:38.312177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-710d415f-0731-4cae-97d2-da1495689600 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.170350 Aug 02 10:50:38.312769 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1708/2825] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:38 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:38.576289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:38.576949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:38.583925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:38.584429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:38.585256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:38.585724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:38.659805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:38.668920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:38.671888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:38.671888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-37367ece-3087-43c0-a855-bb8094b1843c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.099391 Aug 02 10:50:38.672187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1118/2826] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:39.333738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:39.334405 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:39.341020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:39.341458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:39.342316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:39.342748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:39.474792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:39.483604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ddacc7cf-d2af-4016-9706-850247d5b512 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154113 Aug 02 10:50:39.484245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1709/2827] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:39 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:39.695124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:39.695722 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:39.702223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:39.702667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:39.703458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:39.703890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:39.769230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:39.778712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:39.780304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:39.781567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-401c5274-e809-462c-a252-727d57ca64ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091012 Aug 02 10:50:39.782124 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1119/2828] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:39 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:40.505418 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:40.506107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:40.513364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:40.513866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:40.514705 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:40.515143 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:40.646317 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:40.654501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f494ecb1-64c0-4620-a14e-b22b94067aa7 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153106 Aug 02 10:50:40.655071 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1710/2829] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:40 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:40.804213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:40.804870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:40.811375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:40.811824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:40.812577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:40.813009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:40.874904 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:40.883511 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:40.885037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:40.886187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-faff606d-d5fc-4750-982e-042a177436a9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086018 Aug 02 10:50:40.887012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1120/2830] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:40 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:41.676572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:41.677172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:41.683768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:41.684234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:41.685051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:41.685490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:41.819974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:41.828564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c989498e-7444-41bc-b22f-05cb25023b41 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155777 Aug 02 10:50:41.829146 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1711/2831] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:41 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:41.909950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:41.911225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:41.917606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:41.918048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:41.918806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:41.919275 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:41.980338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:41.988895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:41.990416 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:41.991581 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac581c18-d1b4-47e8-a0fe-f6177f360e22 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085643 Aug 02 10:50:41.992125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1121/2832] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:41 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:42.851097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:42.851715 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:42.854108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:42.859108 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:42.859596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:42.860377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:42.860812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:42.994834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:43.003211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-34175af5-3a50-4a9a-897a-d3ac7a8818b9 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156621 Aug 02 10:50:43.003849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1712/2833] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:42 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:43.014192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:43.014869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:43.022142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:43.022710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:43.023811 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:43.023950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:43.088981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:43.098703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:43.100543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:43.101954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f5a21582-d2d0-4256-b9ca-96a095bf8aa2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091890 Aug 02 10:50:43.102459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1122/2834] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:43 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:44.026178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:44.026834 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:44.033474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:44.033917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:44.034673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:44.035102 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:44.125063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:44.125699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:44.133253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:44.133253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:44.134577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:44.134577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:44.167495 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:44.176351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7ae958bd-a353-4b1d-9c3f-4919b159ffa4 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.153997 Aug 02 10:50:44.176936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1713/2835] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:44 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:44.199525 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:44.208909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:44.210529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:44.213213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe9446f0-bad3-411d-aca0-c82e2c358b87 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090808 Aug 02 10:50:44.213213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1123/2836] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:44 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:45.198339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:45.198951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:45.205015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:45.205465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:45.206233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:45.206673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:45.233998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:45.234587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:45.241989 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:45.242431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:45.243213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:45.243638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:45.247857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:45.311091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:45.319810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:45.321372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:45.322536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed42edaf-9ddf-4a5a-b351-43042c47eaa8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092472 Aug 02 10:50:45.323129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1124/2837] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:45 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:50:45.347832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:45.356471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4015286c-5d86-495b-a1f4-32f6a467b03b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.162264 Aug 02 10:50:45.357033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1714/2838] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:45 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:46.345835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:46.346483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:46.353022 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:46.353464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:46.354222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:46.354652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:46.377412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:46.378184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:46.384900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:46.385348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:46.386134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:46.386572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:46.419286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:46.429118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:46.430648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:46.432500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af1e38be-d7d0-4afc-9076-d7ee5f60f911 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090119 Aug 02 10:50:46.433060 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1125/2839] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:46 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:46.515644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:46.523621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b7be9638-5e97-4b84-9d4a-94fd865d407c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.150023 Aug 02 10:50:46.524245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1715/2840] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:46 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:47.455171 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:47.455856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:47.463021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:47.463486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:47.464244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:47.464672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:47.526971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:47.535834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:47.537372 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:47.538530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4cc23a03-4732-4023-ab2c-aa2327984d9e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087307 Aug 02 10:50:47.539496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1126/2841] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:47 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:47.550926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:47.551558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:47.558541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:47.558981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:47.559825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:47.560206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:47.691688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:47.700215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5d7a47dd-a23a-4c13-991c-e8e766749951 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.158569 Aug 02 10:50:47.700789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1716/2842] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:47 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:48.561117 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:48.561729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:48.564032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=54 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:48.569924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:48.570371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:48.571137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:48.571596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:48.635539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:48.644300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:48.645825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:48.646959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-224da241-86e5-436a-b97f-960e9dbb6a23 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.089827 Aug 02 10:50:48.647554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1127/2843] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:48 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:48.722501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:48.723096 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:48.729732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:48.730195 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:48.730950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:48.731419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:48.863067 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:48.871208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9f65b6e5-78a7-4491-9d43-c092b345574a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152585 Aug 02 10:50:48.871777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1717/2844] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:48 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:49.669873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:49.670497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:49.677127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:49.677569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:49.679152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:49.679609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:49.741530 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:49.751763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:49.753264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:49.754401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a83d998a-941f-47c8-99c0-c5129e5037a3 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088567 Aug 02 10:50:49.754959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1128/2845] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:49 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:49.892955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:49.893525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:49.900563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:49.901000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:49.901785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:49.902210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:50.036941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:50.045752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8d9531b-3b60-4617-8c88-80e05f3c7a5b tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156808 Aug 02 10:50:50.046322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1718/2846] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:49 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:50.777660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:50.778284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:50.784922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:50.785351 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:50.786078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:50.786509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:50.848950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:50.857771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:50.859489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:50.860624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-507b4bc6-440e-4791-b59c-c9a44a5de3cf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087095 Aug 02 10:50:50.861248 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1129/2847] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:50 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:51.067299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:51.067938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:51.077286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:51.077975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:51.079353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:51.079915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:51.216913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:51.225075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-05ecb85e-2757-46d4-98ff-7f623d98224c tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.161875 Aug 02 10:50:51.226362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1719/2848] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:51 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:51.887494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:51.888374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:51.894623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:51.895061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:51.895857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:51.896284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:51.957768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:51.966848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:51.968497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:51.969896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8446d5c0-5fb4-4ba3-acab-b195e86ffce7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086782 Aug 02 10:50:51.970629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1130/2849] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:51 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:52.247600 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:52.248206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:52.254735 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:52.255173 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:52.255982 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:52.256406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:52.384106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:52.392410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a5d9789f-b672-4a07-b6d1-2b1fa02da548 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148917 Aug 02 10:50:52.392964 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1720/2850] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:52 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:52.993159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:52.993778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:53.000652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:53.001107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:53.001897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:53.002325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:53.070090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:53.078964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:53.080566 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:53.081720 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a9e8c41-27fb-4fb4-a57d-7a738cf21d74 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.092679 Aug 02 10:50:53.082278 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1131/2851] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:52 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:53.413591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:53.414218 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:53.420975 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:53.421438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:53.422204 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:53.422630 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:53.560928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:53.569928 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cb99ee41-dbc6-4501-8a48-7da18dbec20d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159738 Aug 02 10:50:53.570546 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1721/2852] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:53 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:54.106266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:54.106851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:54.113359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:54.113845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:54.114634 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:54.115069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:54.444432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:54.453358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:54.454890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:54.456265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4de5402-4fca-4a38-9054-d1c6dda6a156 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.354062 Aug 02 10:50:54.456822 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1132/2853] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:54 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:54.604796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:54.605399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:54.611892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:54.612338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:54.613127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:54.613556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:54.746257 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:54.754555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-24ed8b82-acd9-4d3d-bb5a-f88323486c22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.154257 Aug 02 10:50:54.755139 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1722/2854] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:54 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:50:55.480184 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:55.480794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:55.487718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:55.488170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:55.488937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:55.489367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:55.575642 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:55.585272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:55.586799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:55.588175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-358a48f1-0f96-4f65-a407-e00740aa10e1 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.111960 Aug 02 10:50:55.588730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1133/2855] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:55 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:55.777585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:55.778284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:55.785169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:55.785672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:55.786449 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:55.786901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:55.924899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:55.934973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-52fbe8d1-178e-4b7e-8a85-f600bddf8597 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160987 Aug 02 10:50:55.935642 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1723/2856] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:55 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:56.611382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:56.612014 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:56.619028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:56.619505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:56.620279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:56.620725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:56.685302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:56.693729 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:56.695917 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:56.697068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9bc59d3c-bc30-4d19-9198-3cb3eccb0461 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.089748 Aug 02 10:50:56.697624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1134/2857] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:56 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:56.956390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:56.956931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:56.963503 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:56.963954 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:56.964736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:56.965156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:56.969227 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:50:57.095695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:57.104035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-469be132-f8c8-4324-ac71-6dc454b25d6a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151757 Aug 02 10:50:57.104603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1724/2858] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:56 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:57.719355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:57.719964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:57.726413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:57.726854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:57.727652 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:57.728086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:57.790309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:57.798775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:57.800328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:57.801463 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-65438347-acc9-4da7-bfbd-04bdc9d2fb10 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086081 Aug 02 10:50:57.802010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1135/2859] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:57 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:58.125798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:58.126382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:58.133681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:58.134125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:58.134900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:58.135360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:58.264949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:58.273391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c77257a1-59eb-49bf-a2ca-75b4bb45e386 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151465 Aug 02 10:50:58.274056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1725/2860] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:58 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:58.824803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:58.867392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:58.867392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:58.867392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:58.867392 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:58.867909 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:58.895736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:58.904643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:58.906219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:58.907622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-556da347-3c63-4c0b-825f-69f078ea6b4b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086756 Aug 02 10:50:58.907944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1136/2861] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:58 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:50:59.294525 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:59.295140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:59.301777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:59.302226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:59.303005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:59.303455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:59.431902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:50:59.439929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8606a977-83a4-42af-a6f8-db620bfd686f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.149247 Aug 02 10:50:59.440534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1726/2862] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:50:59 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:50:59.930719 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:50:59.931331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:50:59.937881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:59.938323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:59.939083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:50:59.939544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:50:59.998942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:00.007431 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:00.008943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:00.010178 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e37e6f7a-1985-4b3d-8d15-63f6bfd1b1a0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.083958 Aug 02 10:51:00.010623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1137/2863] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:50:59 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:00.462767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:00.463473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:00.469493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:00.469945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:00.470711 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:00.471153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:00.600901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:00.608871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-595c2de4-b9a0-4e39-9b3b-32c1cb770b95 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151001 Aug 02 10:51:00.609443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1727/2864] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:00 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:01.032841 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:01.033473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:01.040035 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:01.040481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:01.041233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:01.041666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:01.103753 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:01.112181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:01.113718 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:01.114863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa737329-ca02-4451-bd2c-ee22f56543c8 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.086018 Aug 02 10:51:01.115461 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1138/2865] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:01 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:01.630252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:01.630863 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:01.637649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:01.638090 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:01.638841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:01.639312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:01.764807 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:01.773199 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5bc58896-5daf-423a-bdfe-57b5f89b8d22 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.146864 Aug 02 10:51:01.773765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1728/2866] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:01 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:02.138236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:02.138867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:02.145407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:02.145846 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:02.146624 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:02.147057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:02.206995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:02.215716 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:02.217230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:02.218359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9a52c575-3ea6-4ba6-b005-c02fdbfeac26 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.084389 Aug 02 10:51:02.218921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1139/2867] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:02 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:02.794883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:02.795481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:02.801943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:02.802383 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:02.803137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:02.803645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:02.942876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:02.951375 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-48cfeb78-8c93-40f1-aee8-0d23b31613d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160599 Aug 02 10:51:02.951929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1729/2868] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:02 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:51:03.242265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:03.242823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:03.249551 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:03.249999 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:03.250895 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:03.251379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:03.314333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:03.317752 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:03.323749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:03.325263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:03.326397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ae42048-5675-4a37-80c5-2d1994f1860c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088898 Aug 02 10:51:03.326950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1140/2869] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:03 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:03.973194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:03.973781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:03.981162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:03.981649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:03.982400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:03.982829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:04.109691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:04.117892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5594624e-6dd9-4679-98e5-64585502625f tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.148644 Aug 02 10:51:04.118453 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1730/2870] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:03 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:04.349691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:04.350857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:04.357655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:04.358099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:04.358856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:04.359312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:04.419495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:04.427912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:04.429492 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:04.430575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a06cad61-6bea-4c40-a062-c58695d1b84f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085312 Aug 02 10:51:04.431371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1141/2871] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:04 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:05.139286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:05.139846 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:05.146433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:05.146874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:05.148279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:05.148703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:05.285274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:05.295389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-14bad363-0186-4b8e-ada1-d88afeb8d7b1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.160707 Aug 02 10:51:05.295971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1731/2872] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:05 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:05.454244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:05.454949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:05.461975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:05.462422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:05.463177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:05.463737 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:05.525585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:05.534778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:05.536434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:05.537600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0ff3382b-4dcc-4224-bd2a-3e9bc039b942 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087709 Aug 02 10:51:05.538374 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1142/2873] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:05 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:06.318142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:06.318818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:06.324867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:06.325302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:06.326058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:06.326481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:06.456698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:06.465321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e808ec32-1084-4fae-90ec-8b8dc0ec04bc tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.151597 Aug 02 10:51:06.465890 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1732/2874] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:06 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:06.561000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:06.561622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:06.568857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:06.569796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:06.570926 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:06.571396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:06.635981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:06.645556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:06.647107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:06.648288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd48f3aa-2abf-480d-aef2-d2e95ae64b41 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091347 Aug 02 10:51:06.648851 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1143/2875] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:06 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:07.486559 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:07.487124 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:07.493593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:07.494444 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:07.494806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:07.495267 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:07.629440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:07.638160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7f678122-b366-4ba4-becb-24b0081e4249 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155860 Aug 02 10:51:07.639724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1733/2876] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:07 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:07.671172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:07.671840 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:07.678381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:07.678834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:07.679633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:07.680071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:07.746804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:07.755597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:07.757777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:07.758919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9eeedf79-ee35-474a-9eb6-253dd9e7a4ff tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.091735 Aug 02 10:51:07.759519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1144/2877] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:07 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:08.659930 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:08.660547 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:08.667766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:08.668221 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:08.668989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:08.669427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:08.786577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:08.787713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:08.799311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:08.800089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:08.801436 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:08.802215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:08.820885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:08.829263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f6b3e2a4-6e25-420e-bb66-7984e881a92a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.173253 Aug 02 10:51:08.829851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1734/2878] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:08 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:08.870034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:08.878353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:08.879908 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:08.881054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-006b0400-98a9-4663-b5f9-e8e64c130a28 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.102038 Aug 02 10:51:08.882145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1145/2879] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:08 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:09.851491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:09.852117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:09.860428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:09.860876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:09.861643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:09.862085 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:09.904342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:09.904962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:09.912595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:09.913377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:09.914823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:09.915498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:09.978992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:09.987697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:09.989215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:09.990363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1ea7287a-8af8-4efc-a624-8e2fd4747d9b tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.090039 Aug 02 10:51:09.990922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1146/2880] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:09 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:09.996014 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:10.004799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dda99424-ae8b-4102-b183-df8ebed29cb8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.157850 Aug 02 10:51:10.005361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1735/2881] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:09 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:11.014086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:11.017932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:11.021797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:11.022256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:11.023051 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:11.023516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:11.025889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:11.026548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:11.033140 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:11.033593 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:11.034379 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:11.034812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:11.086847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:11.095964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:11.101995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:11.101995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ca60422-a692-439e-93b9-efd7ef2bb16a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088954 Aug 02 10:51:11.101995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1147/2882] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:11 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:11.400607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:11.409100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-98a7474b-ff1d-4d82-82dc-858a7e8d392d tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.386967 Aug 02 10:51:11.409721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1736/2883] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:11 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:51:12.122042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:12.122629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:12.129330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:12.129771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:12.130534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:12.130998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:12.194037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:12.203151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:12.204705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:12.205844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a0c6e66c-9880-4fe3-8e8b-e41a4d8c8241 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087914 Aug 02 10:51:12.206397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1148/2884] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:12 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:12.430837 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:12.431420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:12.438170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:12.438611 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:12.439413 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:12.439849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:12.569725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:12.579378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-af6c6120-67e4-4f63-9252-1c59350c06ba tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.152882 Aug 02 10:51:12.580622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1737/2885] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:12 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:13.228493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:13.229116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:13.235700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:13.236255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:13.237016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:13.237447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:13.298378 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:13.306853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:13.308405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:13.309543 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d46dc82-f0a8-4441-bfbd-315810a98830 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085756 Aug 02 10:51:13.310098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1149/2886] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:13 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:13.600801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:13.601394 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:13.603750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=52 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:13.608479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:13.608927 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:13.609687 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:13.610117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:13.788796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:13.793273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6cad07fb-32ba-47a9-a345-765b30949285 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.196406 Aug 02 10:51:13.793847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1738/2887] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:13 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:14.332352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:14.333033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:14.339776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:14.340225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:14.340991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:14.341428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:14.401423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:14.409897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:14.411457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:14.412629 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e123cd8d-e6c8-42df-ab77-7e4fd34ee5ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.084200 Aug 02 10:51:14.413165 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1150/2888] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:14 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:14.888901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:14.889550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:14.895601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:14.896040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:14.896786 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:14.897320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:15.026091 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:15.034971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-97bb0875-ce77-4697-8e91-e838c41b57d1 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.223959 Aug 02 10:51:15.034971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1739/2889] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:14 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:15.436316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:15.436922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:15.443481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:15.443916 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:15.444677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:15.445684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:15.508938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:15.517837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:15.519464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:15.520591 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b7bfdd2a-66e7-49e7-b87a-5b376f2d3926 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.088217 Aug 02 10:51:15.521141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1151/2890] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:15 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:16.057312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:16.057893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:16.064877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:16.065331 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:16.066103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:16.066541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:16.201570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:16.205790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=100 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:16.211812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e65a0327-51e3-4c07-8b5c-e7c36e5c0aab tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.159093 Aug 02 10:51:16.212404 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1740/2891] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:16 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:16.542994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:16.545017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:16.550476 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:16.550921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:16.551717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:16.552150 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:16.616575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:16.625769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:16.627365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:16.628613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3a2d3941-b9a0-496a-a4e6-efd8da0611f6 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.089539 Aug 02 10:51:16.629176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1152/2892] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:16 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:17.234213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:17.234990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:17.241994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:17.242441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:17.243226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:17.243668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:17.377992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:17.386710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c40e8af0-5b7f-4e6a-aa3e-2ff467dd2a93 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156853 Aug 02 10:51:17.387297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1741/2893] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:17 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:17.654056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:17.657682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:17.660872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10a2ee2-07a5-43d7-b3f5-8f382de25a9b", "name": "network-vif-deleted", "tag": "7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:17.661403 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:17.661634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:17.662425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:17.662856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:17.670868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:17.671336 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:17.684631 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] Creating event network-vif-deleted:7b2fb2fd-4869-4fe2-9c4e-c76630eec1b8 for instance f10a2ee2-07a5-43d7-b3f5-8f382de25a9b on hv-cinder-84753 Aug 02 10:51:17.689856 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] [c593218d-b5bc-4db6-9b7e-9eaa3c8dcb3d] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:51:17.725702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:17.734441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:17.735956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:17.737122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4f02646d-c645-474c-a960-0912eecb29d0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.087889 Aug 02 10:51:17.737682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1742/2894] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:17 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:51:18.409813 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:18.410526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:18.418776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:18.419628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:18.420721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:18.421154 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:18.552880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:18.561190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c049b459-995d-46b7-aa0d-67f2994f844a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.156222 Aug 02 10:51:18.561758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1743/2895] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:18 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:51:18.698573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] [c593218d-b5bc-4db6-9b7e-9eaa3c8dcb3d] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43372. Aug 02 10:51:18.702244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-f846e2d6-a28c-41e9-a869-3043fcc02859 req-88ccd9ed-bd16-4c13-955b-74b7eefcc4a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.105673 Aug 02 10:51:18.702872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1153/2896] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:51:18.761575 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:18.762272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:18.771052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:18.773906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:18.775254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:18.775697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:18.842780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:18.851753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:18.853288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:18.854425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6a7f015b-6c27-4e1a-8da3-9a0017e23f3c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.097470 Aug 02 10:51:18.855003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1744/2897] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:18 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:19.582890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:19.583972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:19.585949 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=54 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:19.591031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:19.597963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:19.597963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:19.597963 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:19.725142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:19.733736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc53d6fd-4aad-4516-8217-272df2b4cd4e tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.155351 Aug 02 10:51:19.734301 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1154/2898] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:19 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:19.877162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:19.877726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:19.884305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:19.884760 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:19.885523 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:19.885956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:19.947138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:19.955703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:19.957255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:19.958398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-693d9d41-7320-4bd4-aca3-b309af1f854e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 200 len: 1443 microversion: 2.20 time: 0.085275 Aug 02 10:51:19.958953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1745/2899] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:19 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:19.982539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-334bb2f0-e2be-43cf-944a-462190c7f862 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '.version_select at 0x7f70c2c89430>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:20.117251 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-334bb2f0-e2be-43cf-944a-462190c7f862 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648805018" status: 204 len: 0 microversion: 2.20 time: 0.138543 Aug 02 10:51:20.117874 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1155/2900] 10.222.0.49 () {60 vars in 1259 bytes} [Tue Aug 2 10:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648805018 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:51:20.755410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:20.755980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] [instance: 9fb7d6a1-2042-4138-86b7-fdfe501f1081] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:20.762168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:20.766561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:20.766561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:20.766561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:20.910316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc81b95f6d41bf843bf9aadabcda9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f52a818be854bce9ba1c1405bab4a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:20.918910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0b59e555-ceca-4192-a316-b2624d570ff8 tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081" status: 200 len: 1598 microversion: 2.1 time: 0.167615 Aug 02 10:51:20.919719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1746/2901] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:51:20 2022] GET /compute/v2.1/servers/9fb7d6a1-2042-4138-86b7-fdfe501f1081 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:51:20.939801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-399a11de-40ea-42c9-94d3-b9e8374a869a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] Calling method '.version_select at 0x7f70c2a39550>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:21.037815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-399a11de-40ea-42c9-94d3-b9e8374a869a tempest-TestMinimumBasicScenario-1683556588 tempest-TestMinimumBasicScenario-1683556588-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-547173960" status: 202 len: 0 microversion: 2.1 time: 0.102317 Aug 02 10:51:21.038423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1156/2902] 10.222.0.49 () {58 vars in 1269 bytes} [Tue Aug 2 10:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-547173960 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:51:21.063584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'create', calling method: .version_select at 0x7f70c356d310>, body: {"keypair": {"name": "tempest-keypair-1721455866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/CJRYnWF1299h/V1jH6tDqOkSDKvYwFK+tSITTPUIJCMj+tGE69iRTw7LqRtV8MMzPY1sCtXqFp25Ys+nZCqJ/RRSZ7eIBUcBbtXNIL7zhuMUBRY0A7y8rSoJI0FOhPQ=="}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:21.081122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for project 662f508ce05e4a85896f30f772be6410. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:51:21.086293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for user f6880f2f7ad749beb68cd6445f3cc6d6 and project 662f508ce05e4a85896f30f772be6410. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:51:21.098470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [b3b29af0-e83b-439d-8e19-c8bdbd551a0f] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:51:22.107892 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [b3b29af0-e83b-439d-8e19-c8bdbd551a0f] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43438. Aug 02 10:51:22.164361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:51:22.164625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:51:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.49) !!! Aug 02 10:51:22.242926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dc14561d-391b-48a5-9fb3-267f7e56efbb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.183596 Aug 02 10:51:22.243569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1747/2903] 10.222.0.49 () {62 vars in 1200 bytes} [Tue Aug 2 10:51:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:51:22.898819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:51:22.899366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:51:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:51:25.912559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1649293254", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323ccc74-c2d0-4b0e-8e04-ec0be8a7f34a"}], "security_groups": [{"name": "tempest-securitygroup--1107595170"}], "key_name": "tempest-keypair-1721455866", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:26.141364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] validate_networks() for [('323ccc74-c2d0-4b0e-8e04-ec0be8a7f34a', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:51:26.800865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:51:26.801317 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:51:26.801790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:51:26.802200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:51:26.802610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:51:26.811778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:26.812222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:26.813012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:26.813454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:26.831020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for project 662f508ce05e4a85896f30f772be6410. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:51:26.835465 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Getting quotas for user f6880f2f7ad749beb68cd6445f3cc6d6 and project 662f508ce05e4a85896f30f772be6410. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:51:26.847313 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:51:26.849774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:51:27.008533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e2552b12-134f-45bc-8fbe-a0233e34f9bb tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.101024 Aug 02 10:51:27.010784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1157/2904] 10.222.0.49 () {62 vars in 1188 bytes} [Tue Aug 2 10:51:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 10:51:27.035515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:27.035515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:27.103699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:27.112929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:27.114625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:27.115841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2b00b50f-5e8a-4f19-b8f0-dd0ec0315c27 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1282 microversion: 2.20 time: 0.097681 Aug 02 10:51:27.116629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1748/2905] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:27 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:28.140609 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:28.141277 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:28.148495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:28.148943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:28.149713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:28.150152 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:28.212325 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:28.221243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:28.222881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:28.224033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-77b0e1b1-c1b3-48fa-a7b3-b55ff5145139 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1286 microversion: 2.20 time: 0.088345 Aug 02 10:51:28.224582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1158/2906] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:28 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:29.248138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:29.248871 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:29.255442 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:29.262912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:29.262912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:29.262912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:29.320574 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:29.329315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:29.330853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:29.332251 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a172b757-702b-4b01-b0bd-9ed043b81d60 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1342 microversion: 2.20 time: 0.088774 Aug 02 10:51:29.332818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1749/2907] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:29 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:30.355504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:30.356289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:30.362941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:30.363368 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:30.364132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:30.364660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:30.561572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:30.569946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:30.571507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:30.572660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f790e117-3884-4771-ab9b-aa2bc9f7a39e tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.221281 Aug 02 10:51:30.573221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1159/2908] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:30 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:30.951181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cf5433-613d-4d68-a2d3-e25e8d8cfa59", "tag": "67c2a413-ea1d-4a8f-b768-2994bd6da750"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:30.961370 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:30.961869 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:30.974095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] Creating event network-changed:67c2a413-ea1d-4a8f-b768-2994bd6da750 for instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 on hv-cinder-84753 Aug 02 10:51:30.977695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR oslo.messaging._drivers.impl_rabbit [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] [79480f01-0c2a-4db8-b670-8a5337586330] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:51:31.596263 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:31.596910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:31.603556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:31.604006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:31.604778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:31.605211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:31.734072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:31.737557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:31.742364 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:31.743922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:31.745032 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ebb2ddf-62c6-423d-b8ed-f2489a7a1e50 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.152796 Aug 02 10:51:31.746103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1160/2909] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:31 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:31.985157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] [79480f01-0c2a-4db8-b670-8a5337586330] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43518. Aug 02 10:51:31.988454 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-b4c24109-eda8-4af6-b9a8-798ab5615ef8 req-841b1a6c-be93-4e53-8e4c-a77ba43217c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042873 Aug 02 10:51:31.989053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1750/2910] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:51:32.769407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:32.770213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:32.777520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:32.777995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:32.778756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:32.779208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:32.994160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:33.002305 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:33.004007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:33.005114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4684252c-b17e-482c-927e-cd2cc50011a7 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.240289 Aug 02 10:51:33.005663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1161/2911] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:32 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:34.030827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:34.031554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:34.037728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:34.038169 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:34.038929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:34.039412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:34.171151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:34.179095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:34.180626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:34.181725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b9721264-a13c-4e3a-a5c9-bc38e34e9031 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.156675 Aug 02 10:51:34.182329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1751/2912] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:34 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:35.204113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:35.204727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:35.211413 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:35.211868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:35.212640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:35.213081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:35.342903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:35.351116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:35.352670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:35.353783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-102b0ec1-4a1e-4d1e-9a1a-3b69186379af tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.153693 Aug 02 10:51:35.354342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1162/2913] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:35 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:36.200929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-9ef7e0e2-598b-43a2-a350-7e09402b24ab req-062071da-d3c8-4995-8cf2-778fdc8f857b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cf5433-613d-4d68-a2d3-e25e8d8cfa59", "name": "network-vif-plugged", "status": "completed", "tag": "67c2a413-ea1d-4a8f-b768-2994bd6da750"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:36.214919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-9ef7e0e2-598b-43a2-a350-7e09402b24ab req-062071da-d3c8-4995-8cf2-778fdc8f857b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:36.214919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-9ef7e0e2-598b-43a2-a350-7e09402b24ab req-062071da-d3c8-4995-8cf2-778fdc8f857b service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:36.222937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-9ef7e0e2-598b-43a2-a350-7e09402b24ab req-062071da-d3c8-4995-8cf2-778fdc8f857b service nova] Creating event network-vif-plugged:67c2a413-ea1d-4a8f-b768-2994bd6da750 for instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 on hv-cinder-84753 Aug 02 10:51:36.228237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-9ef7e0e2-598b-43a2-a350-7e09402b24ab req-062071da-d3c8-4995-8cf2-778fdc8f857b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081815 Aug 02 10:51:36.228832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1752/2914] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:51:36.378039 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:36.378654 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:36.385981 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:36.387832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:36.387972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:36.388732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:36.522304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:36.530736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:36.532296 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:36.533824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7124240a-f12a-4e01-a369-68dd5bcdafa9 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.159423 Aug 02 10:51:36.533969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1163/2915] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:36 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:37.554125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:37.558753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:37.559552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:37.565873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:37.566349 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:37.567420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:37.567616 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:37.702422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:37.710496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:37.712063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:37.713159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9eefdd69-6db7-4d98-999d-ae1e47321921 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1408 microversion: 2.20 time: 0.160076 Aug 02 10:51:37.713765 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1753/2916] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:37 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:38.735282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:38.735897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:38.737774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:38.738447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:51:38.743804 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:38.744246 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:38.745007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:38.747621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:38.878129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:38.886209 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:38.888241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:51:38.889662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d23d2fc3-292c-496e-b0cf-d7aeb5fbed98 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1600 microversion: 2.20 time: 0.158466 Aug 02 10:51:38.890210 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1164/2917] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:51:38 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:51:38.912452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:51:38.913032 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:51:38.919644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:38.920092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:38.920849 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:38.921281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:38.996391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f218e99d-c746-4fb6-9f46-7093af19c307 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087828 Aug 02 10:51:38.997000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1754/2918] 10.222.0.49 () {60 vars in 1316 bytes} [Tue Aug 2 10:51:38 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:51:40.093434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-9235dfb9-37cb-49e2-b107-298959c0d695 req-c69cfd2b-8e0f-4c9c-93ba-3d5350adf4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cf5433-613d-4d68-a2d3-e25e8d8cfa59", "tag": "67c2a413-ea1d-4a8f-b768-2994bd6da750"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:51:40.112577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9235dfb9-37cb-49e2-b107-298959c0d695 req-c69cfd2b-8e0f-4c9c-93ba-3d5350adf4c8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:51:40.113026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9235dfb9-37cb-49e2-b107-298959c0d695 req-c69cfd2b-8e0f-4c9c-93ba-3d5350adf4c8 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:51:40.125088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-9235dfb9-37cb-49e2-b107-298959c0d695 req-c69cfd2b-8e0f-4c9c-93ba-3d5350adf4c8 service nova] Creating event network-changed:67c2a413-ea1d-4a8f-b768-2994bd6da750 for instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 on hv-cinder-84753 Aug 02 10:51:40.130445 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-9235dfb9-37cb-49e2-b107-298959c0d695 req-c69cfd2b-8e0f-4c9c-93ba-3d5350adf4c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101062 Aug 02 10:51:40.131533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1165/2919] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:52:16.145215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:52:16.146401 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=62 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:52:16.150392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:52:16.150886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:52:16.157020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:16.157480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:16.158248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:16.158690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:16.182847 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-14bfbbb0-c739-469d-8ec5-b303e7268b7a tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59/ips" status: 200 len: 152 microversion: 2.20 time: 0.039145 Aug 02 10:52:16.183839 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1755/2920] 10.222.0.49 () {60 vars in 1289 bytes} [Tue Aug 2 10:52:16 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:53:16.257939 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:53:16.258705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=26 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:53:16.308798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:16.309507 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:16.315805 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:16.316250 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:16.317008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:16.317441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:16.346905 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:53:16.666166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c9a9115-efbf-4d22-9526-f1c18485e58f tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 204 len: 0 microversion: 2.20 time: 0.410196 Aug 02 10:53:16.668423 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1166/2921] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:53:16 2022] DELETE /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:53:16.678190 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:16.678808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:16.685677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:16.686235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:16.687000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:16.687492 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:16.821259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:16.830470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:16.832040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:16.834855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-6a04fa63-495c-44b0-95f7-da971c7a74ab tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1725 microversion: 2.20 time: 0.161521 Aug 02 10:53:16.834855 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1756/2922] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:16 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:53:17.858197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:17.858971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:17.865677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:17.866128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:17.866893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:17.867366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:18.053443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:18.061561 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:18.063162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:18.064435 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3920d4b2-c849-42d8-ae5a-7c29dc3ee8b2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1725 microversion: 2.20 time: 0.210627 Aug 02 10:53:18.065017 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1167/2923] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:17 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:53:19.088969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:19.089689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:19.096356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:19.096939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:19.097695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:19.098141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:19.169015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:19.177095 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:19.178691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:19.179933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2479afe-05ef-44c7-9b70-0445127aa7bf tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1657 microversion: 2.20 time: 0.095456 Aug 02 10:53:19.180478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1757/2924] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:19 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1657 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:53:19.387864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-2c4cc06d-39b0-43a8-a7f6-700ca9e06b75 req-0270bcf4-8b3b-46db-85b8-f98b3c5a2787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cf5433-613d-4d68-a2d3-e25e8d8cfa59", "name": "network-vif-deleted", "tag": "67c2a413-ea1d-4a8f-b768-2994bd6da750"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:53:19.398522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-2c4cc06d-39b0-43a8-a7f6-700ca9e06b75 req-0270bcf4-8b3b-46db-85b8-f98b3c5a2787 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:19.398992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-2c4cc06d-39b0-43a8-a7f6-700ca9e06b75 req-0270bcf4-8b3b-46db-85b8-f98b3c5a2787 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:19.411314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-2c4cc06d-39b0-43a8-a7f6-700ca9e06b75 req-0270bcf4-8b3b-46db-85b8-f98b3c5a2787 service nova] Creating event network-vif-deleted:67c2a413-ea1d-4a8f-b768-2994bd6da750 for instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 on hv-cinder-84753 Aug 02 10:53:19.416693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-2c4cc06d-39b0-43a8-a7f6-700ca9e06b75 req-0270bcf4-8b3b-46db-85b8-f98b3c5a2787 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034519 Aug 02 10:53:19.417455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1168/2925] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:53:20.204838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:20.205457 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:20.212652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:20.213110 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:20.213886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:20.214319 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:20.249003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:20.249490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:20.249910 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lazy-loading 'fault' on Instance uuid b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:53:20.295538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:20.303643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:20.305175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6880f2f7ad749beb68cd6445f3cc6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662f508ce05e4a85896f30f772be6410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:53:20.306895 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5f5178a2-9b7a-41b4-a20f-bcd882de96b0 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 200 len: 1372 microversion: 2.20 time: 0.107211 Aug 02 10:53:20.307473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1758/2926] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:20 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:53:21.330801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:21.331444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:21.338696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:21.339141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:21.339937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:21.340380 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:21.354242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] HTTP exception thrown: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Request method failure captured: Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 HTTP/1.1 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqfiPRwe5uxvefyh2hB9FhcjyT8YGnIdmIbO3hlhbHQFTpbGDoUSUuI2TLCml73ORmj6LfjQRPTwd5k74bX_E6v_eeBCGd9V7TCVTe09JDA2NwrcjUAfdRpRL5vU9vqVKlTsYBdM88ChkyZSVWrCbpw9yJO1QXC1r_7jb792Y2bRm0 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:53:21.355929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/662f508ce05e4a85896f30f772be6410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_662f508ce05e4a85896f30f772be6410", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: f6880f2f7ad749beb68cd6445f3cc6d6 Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:21.357821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'b7cf5433-613d-4d68-a2d3-e25e8d8cfa59'} Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:53:21.358757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:21.360242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:21.361496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Returning 404 to user: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:53:21.361496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4626f812-872d-4dbf-8044-f73f4597abb2 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 404 len: 111 microversion: 2.20 time: 0.031051 Aug 02 10:53:21.361496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1169/2927] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:21 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:53:21.366367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-61f79cdb-f871-49b8-8830-26b7fe308eba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '.version_select at 0x7f70c2aa19d0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:21.438604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-61f79cdb-f871-49b8-8830-26b7fe308eba tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721455866" status: 204 len: 0 microversion: 2.20 time: 0.076013 Aug 02 10:53:21.439180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1759/2928] 10.222.0.49 () {60 vars in 1262 bytes} [Tue Aug 2 10:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721455866 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 10:53:22.192268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:22.194539 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:22.198750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:22.199204 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:22.199970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:22.200398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:22.216222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] HTTP exception thrown: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Request method failure captured: Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 HTTP/1.1 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqfiPRwe5uxvefyh2hB9FhcjyT8YGnIdmIbO3hlhbHQFTpbGDoUSUuI2TLCml73ORmj6LfjQRPTwd5k74bX_E6v_eeBCGd9V7TCVTe09JDA2NwrcjUAfdRpRL5vU9vqVKlTsYBdM88ChkyZSVWrCbpw9yJO1QXC1r_7jb792Y2bRm0 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:53:22.217790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/662f508ce05e4a85896f30f772be6410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_662f508ce05e4a85896f30f772be6410", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: f6880f2f7ad749beb68cd6445f3cc6d6 Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.219494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'b7cf5433-613d-4d68-a2d3-e25e8d8cfa59'} Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:53:22.220365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.221767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.223598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Returning 404 to user: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:53:22.223598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca1c391d-4fc6-4afc-a559-3b92e3ab0b69 tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 404 len: 111 microversion: 2.20 time: 0.030897 Aug 02 10:53:22.223598 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1170/2929] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 10:53:22 2022] DELETE /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:53:22.227693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:22.228388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: b7cf5433-613d-4d68-a2d3-e25e8d8cfa59] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:53:22.236876 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:22.237320 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:22.238080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:22.238510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:22.251887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] HTTP exception thrown: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Request method failure captured: Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 HTTP/1.1 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqfiPRwe5uxvefyh2hB9FhcjyT8YGnIdmIbO3hlhbHQFTpbGDoUSUuI2TLCml73ORmj6LfjQRPTwd5k74bX_E6v_eeBCGd9V7TCVTe09JDA2NwrcjUAfdRpRL5vU9vqVKlTsYBdM88ChkyZSVWrCbpw9yJO1QXC1r_7jb792Y2bRm0 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:53:22.253524 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/662f508ce05e4a85896f30f772be6410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_662f508ce05e4a85896f30f772be6410", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: f6880f2f7ad749beb68cd6445f3cc6d6 Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.255392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'b7cf5433-613d-4d68-a2d3-e25e8d8cfa59'} Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:53:22.256437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. Aug 02 10:53:22.258155 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:53:22.260246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Returning 404 to user: Instance b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:53:22.260246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-aaf5474d-60e9-4614-8adb-cd902c2a4fea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59" status: 404 len: 111 microversion: 2.20 time: 0.031081 Aug 02 10:53:22.260246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1760/2930] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 10:53:22 2022] GET /compute/v2.1/servers/b7cf5433-613d-4d68-a2d3-e25e8d8cfa59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:54:35.974225 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:54:35.974865 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:54:38.740603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:38.741483 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:38.745370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:38.745881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:38.752074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:38.752523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:38.753290 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:38.753751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:38.778247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:38.779511 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=26 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:38.780879 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:54:38.784217 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:38.785233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:38.792830 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:38.793507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:38.794357 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:38.794850 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:38.824962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:54:39.158501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3a05541c-c946-4cb1-9a1a-497fcad28119 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 204 len: 0 microversion: 2.1 time: 0.419560 Aug 02 10:54:39.159081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1171/2931] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:54:38 2022] DELETE /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:54:39.167858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:39.168632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:39.174575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:39.175018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:39.175807 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:39.176257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:39.186461 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9acb99f3-90ce-4c31-9c52-98fd66f43f5a tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 204 len: 0 microversion: 2.1 time: 0.409823 Aug 02 10:54:39.188990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1761/2932] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:54:38 2022] DELETE /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:54:39.202901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:39.203637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:39.209790 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:39.210239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:39.211043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:39.211504 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:39.311980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:39.320690 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1b180a85-7636-4798-a852-b0f22734ec4e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.156902 Aug 02 10:54:39.321627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1172/2933] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:39 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:54:39.356728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:39.364248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-13c1ce1e-5a83-4c72-a1a1-48ef8a382817 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1682 microversion: 2.1 time: 0.165520 Aug 02 10:54:39.364805 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1762/2934] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:39 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:54:40.342319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:40.344361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:40.349337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:40.349818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:40.350587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:40.351013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:40.386458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:40.387066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:40.394500 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:40.394939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:40.395738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:40.396206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:40.532156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:40.538380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:40.540923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0aee5d7b-e35b-4a38-af22-e5635810d187 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.202458 Aug 02 10:54:40.541517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1173/2935] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:40 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:40.546203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bf7c89f7-3848-4474-975e-b269897c86fb tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1682 microversion: 2.1 time: 0.164202 Aug 02 10:54:40.546864 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1763/2936] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:40 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:54:40.932803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-fc595346-2f9c-445f-bbb3-ae1dce91437c req-ff189dbe-3730-4650-b903-c1568f910476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015594f3-0995-434f-b0b2-e79e4f7a8a77", "name": "network-vif-deleted", "tag": "46a2ac61-dd78-4ec2-a498-bcc8fe863efd"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:40.942377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-fc595346-2f9c-445f-bbb3-ae1dce91437c req-ff189dbe-3730-4650-b903-c1568f910476 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:40.942758 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-fc595346-2f9c-445f-bbb3-ae1dce91437c req-ff189dbe-3730-4650-b903-c1568f910476 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:40.954625 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-fc595346-2f9c-445f-bbb3-ae1dce91437c req-ff189dbe-3730-4650-b903-c1568f910476 service nova] Creating event network-vif-deleted:46a2ac61-dd78-4ec2-a498-bcc8fe863efd for instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 on hv-cinder-84753 Aug 02 10:54:40.960627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-fc595346-2f9c-445f-bbb3-ae1dce91437c req-ff189dbe-3730-4650-b903-c1568f910476 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 Aug 02 10:54:40.961299 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1174/2937] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:54:41.562243 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:41.564398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:41.571168 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:41.571896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:41.577598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:41.578050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:41.578597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:41.579016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:41.579132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:41.579731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:41.579863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:41.580300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:41.617221 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:41.617756 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:41.618452 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lazy-loading 'fault' on Instance uuid 015594f3-0995-434f-b0b2-e79e4f7a8a77 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:54:41.673960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:41.683046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3285c085-e1f1-4af3-89ed-6fd497505014 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 200 len: 1332 microversion: 2.1 time: 0.117203 Aug 02 10:54:41.683925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1175/2938] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:41 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:41.732759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:41.741970 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80bdbe63-01d2-49e4-8ea0-4eef1add0e6e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.183022 Aug 02 10:54:41.742543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1764/2939] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:41 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:42.173427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:54:42.173646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:54:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:54:42.705976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:42.706684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:42.713422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:42.713882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:42.714647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:42.715071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:42.729008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 HTTP/1.1 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:54:42.730691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:54:42.732613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '015594f3-0995-434f-b0b2-e79e4f7a8a77'} Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:42.733659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:54:42.735601 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:54:42.737137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:42.737137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e0885bc6-4782-4223-9fd8-926c9695d5a9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 404 len: 111 microversion: 2.1 time: 0.030069 Aug 02 10:54:42.737137 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1176/2940] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:42 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:54:42.745128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2da28ba5-ce68-4b8c-bf5e-abd384fe7dcd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '.version_select at 0x7f70c373f670>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:42.764419 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:42.765218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:42.771741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:42.772490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:42.773149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:42.773584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:42.816858 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2da28ba5-ce68-4b8c-bf5e-abd384fe7dcd tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517048560" status: 202 len: 0 microversion: 2.1 time: 0.075996 Aug 02 10:54:42.817476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1765/2941] 10.222.0.49 () {58 vars in 1221 bytes} [Tue Aug 2 10:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517048560 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:54:42.907548 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:54:42.907815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:54:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 (ip 10.222.0.49) !!! Aug 02 10:54:42.963834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:42.972000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1b606871-49a3-4e6c-8dc5-538c3df8e563 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.211367 Aug 02 10:54:42.972571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1177/2942] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:42 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:43.758362 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a382eb55-3de2-4860-b089-404d5eb65188 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: .version_select at 0x7f70cb3ed040>, body: {"keypair": {"name": "tempest-keypair-1857297968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBdNFjAPyZFrH7i9S+EsssaTHq8Fz7c65HQ1nBMFOHY7AOFLvN1H2MXk4+HKLidhYsjUKvx3RRMYL2ZP2MW1cbsAgbWbj/YuSyv5Mulayztjulkvdl+pz/8l4CByTKGCQ=="}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:43.774451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-a382eb55-3de2-4860-b089-404d5eb65188 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:54:43.778179 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-a382eb55-3de2-4860-b089-404d5eb65188 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:54:43.891601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a382eb55-3de2-4860-b089-404d5eb65188 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138358 Aug 02 10:54:43.892197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1766/2943] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:54:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:54:43.994375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:43.994996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:44.001618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:44.002081 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:44.002845 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:44.003322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:44.142657 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:44.151216 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-691cc9c9-7a97-4dc5-af7e-f3713e716ff9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.161455 Aug 02 10:54:44.154594 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1178/2944] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:43 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:45.173350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:45.173951 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:45.180561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:45.181006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:45.181762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:45.182200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:45.373116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:45.381256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d8018742-c0f1-4a23-9e61-4ade4e15a43f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.212521 Aug 02 10:54:45.381933 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1767/2945] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:45 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:46.403441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:46.404061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:46.410898 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:46.411443 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:46.415920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:46.415920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:46.490450 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-330441194", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c49660-b8e9-4548-b1ea-a7c2e86c6f47"}], "security_groups": [{"name": "tempest-securitygroup--1267118469"}], "key_name": "tempest-keypair-1857297968", "user_data": "}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:46.552215 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:46.561009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89cbf93d-2585-4793-ba1d-9f9a5b6f2c46 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.161545 Aug 02 10:54:46.561973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1179/2946] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:46 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:46.604938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] validate_networks() for [('11c49660-b8e9-4548-b1ea-a7c2e86c6f47', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:54:47.256515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:54:47.257438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:54:47.257909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:54:47.258318 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:54:47.258729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:54:47.267629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:47.268080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:47.268877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:47.269563 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:47.286812 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:54:47.290776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Getting quotas for user d2ee2b6dd6f647179d2af999b3e62788 and project 0dc1c45a26e84a3bbc06d52fec42e332. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:54:47.301799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:54:47.304118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:54:47.454162 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-36f4c63b-2c7e-49e2-844f-a81d81945b17 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.968010 Aug 02 10:54:47.454745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1768/2947] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:54:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:54:47.466147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4cd4f649-f360-4b8f-9ebf-0144004f60bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:47.466775 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4cd4f649-f360-4b8f-9ebf-0144004f60bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:47.523355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4cd4f649-f360-4b8f-9ebf-0144004f60bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:47.532575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4cd4f649-f360-4b8f-9ebf-0144004f60bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1241 microversion: 2.1 time: 0.070613 Aug 02 10:54:47.533485 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1180/2948] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:47 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:47.582488 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:47.583728 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:47.591134 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:47.591545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:47.592358 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:47.592748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:47.726425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:47.734851 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c24f268f-d5ca-4bcc-b4ac-05894a52799d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.156592 Aug 02 10:54:47.735447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1769/2949] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:47 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:54:48.557147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:48.558358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:48.567667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:48.568116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:48.568885 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:48.569980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:48.633050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:48.641006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e2b13c7a-d717-4bbb-87a9-6aa31b4f45b4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1245 microversion: 2.1 time: 0.090606 Aug 02 10:54:48.641579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1181/2950] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:48 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:48.757622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:48.758224 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:48.764749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:48.765194 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:48.765945 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:48.766372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:48.900395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:48.908458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-130be68d-d042-4e32-b2e7-e3b9173fe49a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155178 Aug 02 10:54:48.909329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1770/2951] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:48 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:49.662771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:49.663996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:49.670903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:49.671686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:49.672451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:49.673058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:49.736333 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:49.744377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de80458b-e9f0-4c4f-917a-0383367c60d7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1311 microversion: 2.1 time: 0.085481 Aug 02 10:54:49.745149 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1182/2952] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:49 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:49.929999 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:49.930606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:49.937884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:49.938336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:49.939929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:49.940380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:50.072691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:50.080647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4489fb14-2660-43d5-b6bd-be8b367e93ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.154594 Aug 02 10:54:50.081205 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1771/2953] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:49 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:50.766075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:50.766768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:50.773767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:50.774208 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:50.774969 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:50.775587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:50.986998 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:50.994990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-091ba68f-5132-4c60-930a-30b69f6ac575 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.232805 Aug 02 10:54:50.995597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1183/2954] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:50 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:51.103207 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:51.103929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:51.110410 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:51.111594 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:51.111736 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:51.112092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:51.247019 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:51.255326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-92061be6-f10c-47c0-9719-0069fba1a81b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.156435 Aug 02 10:54:51.256122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1772/2955] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:51 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:51.427005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-014563e9-d39e-4f41-8f60-ebd73d430bc8 req-14f0147b-6ed2-4280-8ad7-3290ac897e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4183b2e-fe28-46ad-afa8-b54b4664788c", "tag": "d18e2c9a-4f8a-4ddc-b96e-d319944daeb0"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:51.436922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-014563e9-d39e-4f41-8f60-ebd73d430bc8 req-14f0147b-6ed2-4280-8ad7-3290ac897e19 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:51.437365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-014563e9-d39e-4f41-8f60-ebd73d430bc8 req-14f0147b-6ed2-4280-8ad7-3290ac897e19 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:51.449687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-014563e9-d39e-4f41-8f60-ebd73d430bc8 req-14f0147b-6ed2-4280-8ad7-3290ac897e19 service nova] Creating event network-changed:d18e2c9a-4f8a-4ddc-b96e-d319944daeb0 for instance e4183b2e-fe28-46ad-afa8-b54b4664788c on hv-cinder-84753 Aug 02 10:54:51.454025 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-014563e9-d39e-4f41-8f60-ebd73d430bc8 req-14f0147b-6ed2-4280-8ad7-3290ac897e19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031027 Aug 02 10:54:51.454703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1184/2956] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:54:52.016007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:52.016622 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:52.023024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:52.023502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:52.024274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:52.024704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:52.163922 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:52.171510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4546e0a7-8bda-4852-bd49-038381058a3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.159292 Aug 02 10:54:52.172256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1773/2957] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:52 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:52.278429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:52.279044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:52.285239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:52.285674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:52.286418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:52.286844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:52.418819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:52.426767 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac67e485-38dd-43ca-9c73-19d8baf329bc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153201 Aug 02 10:54:52.427359 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1185/2958] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:52 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:53.192528 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.193148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:53.200133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:53.200569 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:53.201327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:53.201757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:53.332747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:53.340818 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4d311c45-e058-4e7e-85e1-fa92b8aa22b9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.152366 Aug 02 10:54:53.341420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1774/2959] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:53 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:53.449177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.449751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:53.456472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:53.456920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:53.457677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:53.458111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:53.586133 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:53.594458 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa9b80ae-4351-4432-976b-8e4c08e34f7c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.149886 Aug 02 10:54:53.595177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1186/2960] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:53 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:54.360558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:54.361159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:54.367740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:54.368180 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:54.368929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:54.369356 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:54.501253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:54.508704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bceaabf2-24f6-4430-b202-62fef52016bf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.151917 Aug 02 10:54:54.509261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1775/2961] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:54 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:54.614592 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:54.615158 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:54.621615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:54.622057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:54.622815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:54.623285 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:54.750470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:54.759479 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-50525604-7038-42be-9b1a-69d70c32496f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.148736 Aug 02 10:54:54.759995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1187/2962] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:54 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:55.530127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:55.530808 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:55.538734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:55.539228 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:55.540004 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:55.540441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:55.669475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:55.677106 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0941f86d-fb58-4c7d-93da-fbda4e9463c2 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.150924 Aug 02 10:54:55.677676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1776/2963] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:55 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:55.786192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:55.786801 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:55.793974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:55.794427 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:55.795230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:55.795645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:55.815672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:55.933338 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:55.941309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee50b6ae-2723-4d6f-8423-d7f5bd52fce3 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.159535 Aug 02 10:54:55.941873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1188/2964] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:55 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:56.698414 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:56.699023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:56.705645 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:56.706087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:56.706859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:56.707325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:56.841739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:56.850938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bda4063c-7a31-4783-b878-42faa41dbbd4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.156301 Aug 02 10:54:56.851548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1777/2965] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:56 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:56.963647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:56.964254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:56.970512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:56.970954 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:56.971740 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:56.972172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:57.087873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-5855f19b-7d29-4712-9040-a8aca9d4f57e req-3d339afe-a0e4-42fc-910b-a9e217232b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4183b2e-fe28-46ad-afa8-b54b4664788c", "name": "network-vif-plugged", "status": "completed", "tag": "d18e2c9a-4f8a-4ddc-b96e-d319944daeb0"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:57.103461 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-5855f19b-7d29-4712-9040-a8aca9d4f57e req-3d339afe-a0e4-42fc-910b-a9e217232b22 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:57.103967 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-5855f19b-7d29-4712-9040-a8aca9d4f57e req-3d339afe-a0e4-42fc-910b-a9e217232b22 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:57.106187 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:57.114407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a18ce32f-107c-43a2-b8ec-238416bb189b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155404 Aug 02 10:54:57.114982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1189/2966] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:56 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:57.115628 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-5855f19b-7d29-4712-9040-a8aca9d4f57e req-3d339afe-a0e4-42fc-910b-a9e217232b22 service nova] Creating event network-vif-plugged:d18e2c9a-4f8a-4ddc-b96e-d319944daeb0 for instance e4183b2e-fe28-46ad-afa8-b54b4664788c on hv-cinder-84753 Aug 02 10:54:57.121011 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-5855f19b-7d29-4712-9040-a8aca9d4f57e req-3d339afe-a0e4-42fc-910b-a9e217232b22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038367 Aug 02 10:54:57.124898 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1778/2967] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:54:57.875559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:57.876173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:57.878004 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:57.882837 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:57.883310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:57.884071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:57.884504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:58.019036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:58.027746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8445bfc4-32e8-429a-a49b-76cc80d4caaf tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.156091 Aug 02 10:54:58.028306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1190/2968] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:57 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:58.136374 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:58.137076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:58.139076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:58.139828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=10 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:58.145603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:58.146566 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:58.146798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:58.147255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:58.151857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:58.283166 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:58.292346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-673c52d9-2357-4110-8529-bce844e92440 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.160284 Aug 02 10:54:58.297287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1779/2969] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:58 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:54:59.049231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:59.049832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:59.057789 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:59.058330 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:59.059113 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:59.059582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:59.189180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:59.197063 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c364c1f4-2496-4396-b270-84e4591c0f19 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1367 microversion: 2.1 time: 0.151937 Aug 02 10:54:59.197644 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1191/2970] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:59 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:54:59.313743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:59.314350 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:54:59.320749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:59.321182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:59.321939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:59.322372 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:59.450443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:54:59.458487 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80bdf662-2703-47b0-9df2-c3e0f76d992e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.149296 Aug 02 10:54:59.459073 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1780/2971] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:54:59 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:00.218223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:00.218798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:00.225490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.225934 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.226696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.227130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.358348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:00.365953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9dd5623b-b669-4631-95e1-9663c17ea345 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1557 microversion: 2.1 time: 0.151761 Aug 02 10:55:00.367042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1192/2972] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:00 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:00.387420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:00.388049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:00.394515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.395273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.396053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.396490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.477988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-46773dd3-3b5d-4258-9f0c-724f22b3b3b0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094532 Aug 02 10:55:00.478691 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1781/2973] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:55:00 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:00.479031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:00.479810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:00.485941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.486233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.486994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:00.487473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:00.621013 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:00.629086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9b05ee7e-6b7e-44cc-b2dc-807906dbc3f1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153888 Aug 02 10:55:00.629658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1193/2974] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:00 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:01.463707 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-cf43ea17-0990-4a60-9c3d-8883e947b331 req-034b8fd7-2de9-4485-8d90-93e685b33437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4183b2e-fe28-46ad-afa8-b54b4664788c", "tag": "d18e2c9a-4f8a-4ddc-b96e-d319944daeb0"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:01.472986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-cf43ea17-0990-4a60-9c3d-8883e947b331 req-034b8fd7-2de9-4485-8d90-93e685b33437 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:01.473417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-cf43ea17-0990-4a60-9c3d-8883e947b331 req-034b8fd7-2de9-4485-8d90-93e685b33437 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:01.486268 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-cf43ea17-0990-4a60-9c3d-8883e947b331 req-034b8fd7-2de9-4485-8d90-93e685b33437 service nova] Creating event network-changed:d18e2c9a-4f8a-4ddc-b96e-d319944daeb0 for instance e4183b2e-fe28-46ad-afa8-b54b4664788c on hv-cinder-84753 Aug 02 10:55:01.491330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-cf43ea17-0990-4a60-9c3d-8883e947b331 req-034b8fd7-2de9-4485-8d90-93e685b33437 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032312 Aug 02 10:55:01.492240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1782/2975] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:01.651064 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:01.651995 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:01.659639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:01.659639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:01.660197 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:01.660705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:01.865314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:01.879371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b84ec005-c035-4555-a3ff-7f6ab257a48a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.232660 Aug 02 10:55:01.880356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1194/2976] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:01 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:02.905333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:02.906031 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:02.912284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:02.912729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:02.913509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:02.913939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:03.044578 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:03.052470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1276591c-6334-4a10-8f37-ebfc6ee4b9c1 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151942 Aug 02 10:55:03.053028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1783/2977] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:02 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:04.073454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:04.074075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:04.081344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:04.081803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:04.082604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:04.083042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:04.213534 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:04.225034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c95bcde-004d-47b8-9cb7-04686bb106ef tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155478 Aug 02 10:55:04.226183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1195/2978] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:04 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:05.247176 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:05.247993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:05.254708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:05.255150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:05.256036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:05.256477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:05.386359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:05.394313 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f702b4db-c3af-499e-a0f9-6eff1bfa5d2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.150987 Aug 02 10:55:05.395126 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1784/2979] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:05 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:06.416236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:06.416883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:06.423665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:06.424118 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:06.424893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:06.425332 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:06.562743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:06.570910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-112578f3-3c34-4ebb-b1da-fd3b292eff98 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.158729 Aug 02 10:55:06.571517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1196/2980] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:06 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:07.594486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:07.595253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:07.604678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:07.605122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:07.605906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:07.606329 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:07.745070 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:07.753391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-031489a8-f2ee-4d71-83be-7f212f436732 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.164609 Aug 02 10:55:07.753965 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1785/2981] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:07 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:08.776172 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:08.776797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:08.783496 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:08.784002 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:08.784700 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:08.785127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:08.914127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:08.922109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4f94aa12-5fdb-4d12-9a2c-5f14f59b644e tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.150335 Aug 02 10:55:08.922670 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1197/2982] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:08 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:09.943513 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:09.944423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:09.947259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:09.952142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:09.952589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:09.953351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:09.953789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:10.091989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:10.100138 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-40787e11-42e6-4de4-b58d-fbbd1f4e9985 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.160531 Aug 02 10:55:10.100738 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1786/2983] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:09 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:11.121681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:11.122355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:11.124935 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:11.130235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:11.130677 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:11.131489 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:11.132453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:11.272082 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:11.280918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5184ce22-3221-4427-910a-c7cc126575ca tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.163174 Aug 02 10:55:11.281689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1198/2984] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:11 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:12.301981 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:12.302581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:12.309241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:12.314297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:12.314297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:12.314297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:12.447662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:12.455905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e22efb1-b375-4073-acce-ae8e307ca528 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.158135 Aug 02 10:55:12.456483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1787/2985] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:12 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:13.478454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:13.479071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:13.486280 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:13.486727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:13.487542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:13.487983 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:13.636344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:13.644800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9756b17f-1367-4bf5-ad3e-fa234b80f252 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.170829 Aug 02 10:55:13.645640 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1199/2986] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:13 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:14.668025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:14.668704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:14.674865 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:14.675360 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:14.676121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:14.676560 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:14.813280 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:14.822038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b10e2cae-ff4a-4dd8-af34-ed522ed52d20 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.157933 Aug 02 10:55:14.822606 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1788/2987] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:14 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:15.844353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.844994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:15.852293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:15.852736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:15.853532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:15.853965 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:15.987869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:15.996115 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a98981b0-37d2-4f22-bd06-36a9379f3077 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155640 Aug 02 10:55:15.996711 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1200/2988] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:17.017438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:17.018053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:17.025545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:17.025929 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:17.026719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:17.027433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:17.174206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:17.183352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e6cef429-d717-498e-b69f-7447b441035d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.170176 Aug 02 10:55:17.183941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1789/2989] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:17 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:18.204932 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:18.205494 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:18.212863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:18.213311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:18.214088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:18.214520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:18.378265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:18.386748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-81871cec-2252-4751-b2c7-04855fd5af3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.185729 Aug 02 10:55:18.387389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1201/2990] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:18 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:19.421339 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:19.421947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:19.429380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.429835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.430697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.431133 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.569365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:19.577708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e5ccb4d-c9bb-4be7-9783-cdea94b66943 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.160839 Aug 02 10:55:19.578279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1790/2991] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:19 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:20.599852 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:20.600495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:20.607349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:20.607855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:20.608646 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:20.609074 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:20.742233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:20.750493 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3558da6e-0f82-4f7e-96cf-30400cc55b9f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.154955 Aug 02 10:55:20.751145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1202/2992] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:20 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:21.773896 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:21.774529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:21.782080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.782493 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:21.783305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.783737 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:21.922305 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:21.931427 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8e159ec1-3940-439a-9d53-8e76ca598bcd tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.162411 Aug 02 10:55:21.932171 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1791/2993] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:21 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:22.953164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:22.955067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:22.965923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.966363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.967141 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.967606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.112006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.124281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d311be02-a896-4e6b-8688-d5702b7e711c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.175340 Aug 02 10:55:23.124875 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1203/2994] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:22 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:24.146476 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:24.147117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:24.153832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.154282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.155119 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.155499 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.305092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.320771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a655ce11-5a97-4184-9d31-2d1b9694130c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.178040 Aug 02 10:55:24.321853 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1792/2995] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:24 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:25.343747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:25.344412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:25.351114 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.351604 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.352393 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.352834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.496224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.510213 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6454a645-187e-44fb-ad81-8094c1366cba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.170136 Aug 02 10:55:25.511558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1204/2996] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:25 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:26.538603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:26.539801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:26.551541 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.552160 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:26.553568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.554354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:26.699398 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:26.707883 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-33241e33-aa91-4a6e-9226-b4d8211e322b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.174732 Aug 02 10:55:26.708470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1793/2997] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:26 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:27.730709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:27.732083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:27.739376 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.739823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.740622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.741776 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.744679 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=99 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:27.879994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:27.888425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4f6cc81-8772-4972-8229-575feebd0392 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.161449 Aug 02 10:55:27.889071 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1205/2998] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:27 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:28.913150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:28.913770 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:28.920440 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.920882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.921759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.922187 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.057246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.065380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0da2491e-e95c-4cb1-bd0c-e31ecf70e22f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.156232 Aug 02 10:55:29.065962 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1794/2999] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:28 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:30.087538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:30.088142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:30.094647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.095095 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.095890 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.096361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.234268 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.243655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-15b3084f-673c-4961-897a-bdb0b80bc062 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.160642 Aug 02 10:55:30.244236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1206/3000] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:30 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:31.272161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:31.273310 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:31.279971 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.280452 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.281222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.281660 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.284354 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=89 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:31.423219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:31.431783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d290735a-b0ee-453e-94cb-fded1dc5c4dc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.163709 Aug 02 10:55:31.432368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1795/3001] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:31 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:32.452754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:32.453370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:32.460735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.461175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.461938 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.462370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.595323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:32.604243 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f47cc593-a34c-49e8-a422-c694dbf95cea tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155354 Aug 02 10:55:32.604816 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1207/3002] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:32 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:33.625340 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:33.625980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:33.632579 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.633021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.633781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.634212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.761125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.769065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7c2cb8dd-ea2a-4a37-9a32-44bfe38ceec9 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.147606 Aug 02 10:55:33.769666 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1796/3003] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:33 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:34.790596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:34.791219 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:34.797681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.798121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.798861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.799315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.937817 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:34.946547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-be750760-0fed-47b6-ad25-092c6fe2923f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.159923 Aug 02 10:55:34.970019 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1208/3004] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:34 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:35.967888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:35.968512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:35.975135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.976122 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:35.976900 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.977336 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.113677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.121935 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7f1acc79-e5e8-45a8-8c50-9baa113d3af2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.157948 Aug 02 10:55:36.122526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1797/3005] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:35 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:37.143616 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.144260 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:37.151482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.156379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.156379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.156379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.285112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.285733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:37.289697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:37.292938 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.293399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.294178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.294614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.298191 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-07f582e0-d649-47fb-b141-4056ac666d6f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.158616 Aug 02 10:55:37.305287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1209/3006] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:37.317913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-405a8f26-4996-4392-b9ce-e62877812183 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036684 Aug 02 10:55:37.318485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1798/3007] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:38.325110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:38.325724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:38.332556 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.333000 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.333808 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.334240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.470712 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.479501 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-98ba26f1-57b6-4475-add3-fecf03345734 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.158388 Aug 02 10:55:38.480271 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1210/3008] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:38 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:39.503474 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:39.504104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:39.512800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.513264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.514009 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.514437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.648542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:39.656673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d571b036-12ac-4a62-8081-cebbb12a316b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.158515 Aug 02 10:55:39.657235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1799/3009] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:39 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:40.678003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:40.679307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:40.686089 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.686531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.687328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.687761 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.818742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.827261 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-66d7c1bd-4b21-46d2-b363-8b4223f8c99c tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153165 Aug 02 10:55:40.827815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1211/3010] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:40 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:41.848731 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:41.849325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:41.856609 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.857051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.857806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.858233 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.989915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:41.998496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a99ab273-79b2-418f-af7e-9494e3f56e6b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.154050 Aug 02 10:55:41.999058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1800/3011] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:41 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:43.020077 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:43.020797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:43.023893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=28 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:43.029583 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.030321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.031173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.031653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.182645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.190930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3aba70f0-bab4-4800-8a16-329395c2ddcc tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.175170 Aug 02 10:55:43.191533 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1212/3012] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:43 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:44.214247 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.214806 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.217299 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=30 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:44.222302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.222748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.223551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.224039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.360023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:44.368021 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0045bfff-c2e9-4539-93c8-9c37bf6c497b tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.159497 Aug 02 10:55:44.368591 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1801/3013] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:45.388241 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:45.388798 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:45.395399 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:45.395848 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:45.396858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:45.397770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:45.529899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:45.539590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-86d21ac1-ea3d-4ff6-a73a-1fafd9d07a0d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155324 Aug 02 10:55:45.540217 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1213/3014] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:45 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:46.560565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:46.561177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:46.567713 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.568164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.568931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.569365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.698960 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:46.706909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1b68f86f-48cd-4593-a465-2854e2904608 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.150239 Aug 02 10:55:46.707507 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1802/3015] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:46 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:47.729160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:47.729796 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:47.736468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:47.736918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:47.737703 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:47.738144 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:47.869464 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:47.877745 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-91e2a4e5-513c-42b6-816f-82184a902b7f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153082 Aug 02 10:55:47.878322 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1214/3016] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:47 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:48.900649 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:48.901222 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:48.907793 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.908245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:48.909010 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.909448 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:49.039302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:49.047576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ed62c06a-b5b7-467c-a768-e7e1c5520a05 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151750 Aug 02 10:55:49.048141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1803/3017] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:48 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:50.069398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:50.070036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:50.076721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:50.077162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:50.077923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:50.078357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:50.209080 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:50.217398 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c1a8e0f-5e87-480a-99e0-d290a1a02d4f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151994 Aug 02 10:55:50.217994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1215/3018] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:50 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:51.238852 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:51.241905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:51.246392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:51.246826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:51.247618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:51.248046 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:51.375494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:51.383634 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-058d9579-6241-4823-9615-0a019e13155f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.148631 Aug 02 10:55:51.384801 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1804/3019] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:51 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:52.406294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:52.406922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:52.413482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:52.413931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:52.414688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:52.415122 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:52.545648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:52.553626 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f8d97090-aed4-40cc-a069-adb166dcddf4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151263 Aug 02 10:55:52.554186 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1216/3020] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:52 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:53.577917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:53.578534 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:53.585112 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:53.585558 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:53.586323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:53.586750 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:53.714219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:53.722157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b0825265-c9d9-43ee-ac9a-134e0685ad90 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.148155 Aug 02 10:55:53.722719 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1805/3021] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:53 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:54.744075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:54.745367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:54.751896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:54.752334 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:54.753091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:54.753506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:54.880996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:54.889267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eeb81f9b-f7cd-418d-a606-612eb1754a2f tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.149255 Aug 02 10:55:54.889831 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1217/3022] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:54 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:55.910926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:55.911556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:55.918795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:55.919254 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:55.920068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:55.920489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:56.053536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:56.062109 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7896901e-e91c-4e6d-b17b-e11de682ce2d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.155005 Aug 02 10:55:56.062668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1806/3023] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:55 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:57.083370 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:57.083933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:57.090617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:57.091061 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:57.091850 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:57.092282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:57.224610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:57.232786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4ffb2d49-ae9f-41fd-87c7-4b138803ec8d tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153408 Aug 02 10:55:57.233349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1218/3024] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:57 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:58.253889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:58.254506 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:58.261565 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.262000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.262758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.263203 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.388721 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:58.396601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7cf00358-17ca-4286-b79a-db9ff872b1ec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.146574 Aug 02 10:55:58.397464 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1807/3025] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:58 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:59.418636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:59.454607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:59.454607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:59.454607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:59.454607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:59.455111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:59.455111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=84 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:59.558809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:59.566835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11b3f29d-a5db-4bf4-ae60-8c244e428fba tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.152231 Aug 02 10:55:59.567417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1219/3026] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:55:59 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:00.588779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:00.589422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:00.595974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:00.596425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:00.597213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:00.597631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:00.729416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:00.738423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ba5ccdb-75fa-44ad-9412-9e7954d73476 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.153566 Aug 02 10:56:00.738995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1808/3027] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:00 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:01.760139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:01.760747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:01.767235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:01.767692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:01.768510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:01.768881 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:01.899792 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:01.907742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6f2eb841-29ab-4ff2-9fca-197040c9f0d2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151590 Aug 02 10:56:01.908309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1220/3028] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:01 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:02.928745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:02.929303 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:02.936443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:02.936889 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:02.937653 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:02.938084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:02.940644 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=82 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:03.081118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:03.089693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3202148e-f37c-4762-848c-0b5e10b06aec tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.164423 Aug 02 10:56:03.090263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1809/3029] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:02 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:04.110709 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:04.111337 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:04.118125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.118567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.119432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.119929 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.249849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:04.257952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c5ee059-7d15-45ca-a28c-0b26671b6fd2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.151173 Aug 02 10:56:04.258524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1221/3030] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:04 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:05.279675 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:05.280308 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:05.286718 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:05.287153 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:05.287931 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:05.288359 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:05.422035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:05.430150 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8c81bb2d-5188-44f3-80f8-4d71b3e81a69 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.154464 Aug 02 10:56:05.430723 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1810/3031] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:05 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:06.452344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:06.452971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:06.460639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.461100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.461862 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.462289 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.599540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:06.607903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fafc5ff1-f267-434a-9512-f76b87bfca3a tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.160503 Aug 02 10:56:06.608481 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1222/3032] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:06 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:07.629182 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:07.629782 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:07.636342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:07.636780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:07.637545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:07.637988 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:07.781043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:07.787714 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7605948e-55e3-4286-8b2e-5578848a18ad tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1559 microversion: 2.1 time: 0.162527 Aug 02 10:56:07.788389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1811/3033] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:07 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:08.152588 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:08.153205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:08.159900 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.160352 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.161123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.161564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.188340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:56:08.646426 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f882f155-cc19-4f2f-9da8-fd07505073ae tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "DELETE /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 204 len: 0 microversion: 2.1 time: 0.497530 Aug 02 10:56:08.647531 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1223/3034] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:08 2022] DELETE /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:56:08.658371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:08.659533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:08.666989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.667505 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.668273 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.668699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.802030 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:08.811371 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:08.812185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:08.812355 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ef7a4e0c-c62c-4fb9-ab08-94411b56523d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1508 microversion: 2.1 time: 0.160220 Aug 02 10:56:08.813281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1812/3035] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:08 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:08.818577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.819125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.819980 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.820478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.889912 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320b84ea-12e7-458f-a521-fe535189d323"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:08.892777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:08.899314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.899767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:08.900535 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:08.900984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:09.020620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:09.026029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d01c9cb-7b4a-418a-9794-5afe55c354f2 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1513 microversion: 2.1 time: 0.218925 Aug 02 10:56:09.026596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1224/3036] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:08 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:09.227459 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-61d71158-7380-4b44-a29c-42eb4801b27f req-d917ef7c-2bb9-49ff-8392-a020f6dae759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb7d6a1-2042-4138-86b7-fdfe501f1081", "name": "network-vif-deleted", "tag": "c4f3f335-8942-45b4-8620-77369a2b71e5"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:09.237151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-61d71158-7380-4b44-a29c-42eb4801b27f req-d917ef7c-2bb9-49ff-8392-a020f6dae759 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:09.237585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-61d71158-7380-4b44-a29c-42eb4801b27f req-d917ef7c-2bb9-49ff-8392-a020f6dae759 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:09.254515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-61d71158-7380-4b44-a29c-42eb4801b27f req-d917ef7c-2bb9-49ff-8392-a020f6dae759 service nova] Creating event network-vif-deleted:c4f3f335-8942-45b4-8620-77369a2b71e5 for instance 9fb7d6a1-2042-4138-86b7-fdfe501f1081 on hv-cinder-84753 Aug 02 10:56:09.256224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-61d71158-7380-4b44-a29c-42eb4801b27f req-d917ef7c-2bb9-49ff-8392-a020f6dae759 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 Aug 02 10:56:09.257162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1225/3037] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:09.834903 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:09.835735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:09.844360 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:09.849689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:09.849689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:09.849689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:09.992933 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:10.001121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ff57728b-6a0b-46ad-be95-e987354eda8d tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1508 microversion: 2.1 time: 0.170894 Aug 02 10:56:10.001706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1226/3038] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:09 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:10.051901 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:10.053169 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:10.061166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:10.061618 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:10.062410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:10.062824 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:10.160389 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:10.174175 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a6e8e5a9-303d-4739-9fff-bbd71e2fea15 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1471 microversion: 2.1 time: 0.129174 Aug 02 10:56:10.174923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1227/3039] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:10 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1471 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:10.213327 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-848366fc-b9e6-442a-9537-06c0c608d75f req-8989fbbb-f2f7-42e2-9980-0a46f0aee565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88583914-a127-4108-9fd8-74a4a6707e47", "name": "network-vif-deleted", "tag": "a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:10.225335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-848366fc-b9e6-442a-9537-06c0c608d75f req-8989fbbb-f2f7-42e2-9980-0a46f0aee565 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:10.225936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-848366fc-b9e6-442a-9537-06c0c608d75f req-8989fbbb-f2f7-42e2-9980-0a46f0aee565 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:10.238754 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-848366fc-b9e6-442a-9537-06c0c608d75f req-8989fbbb-f2f7-42e2-9980-0a46f0aee565 service nova] Creating event network-vif-deleted:a00a3e4f-a5bf-4fc3-b8ae-697c6c58ab5b for instance 88583914-a127-4108-9fd8-74a4a6707e47 on hv-cinder-84753 Aug 02 10:56:10.244098 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-848366fc-b9e6-442a-9537-06c0c608d75f req-8989fbbb-f2f7-42e2-9980-0a46f0aee565 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Aug 02 10:56:10.245771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1228/3040] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:56:10.251293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-ee623562-403b-4f17-b8ee-0727a70616a0 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "POST /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.365771 Aug 02 10:56:10.253184 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1813/3041] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:56:08 2022] POST /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments => generated 194 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:56:11.023282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:11.023987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:11.030499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.030950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.031750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.032185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.064802 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.065255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.065708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lazy-loading 'fault' on Instance uuid daefd063-bf57-4fcd-b586-348ca02fcbcc {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:11.107306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:11.116978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc1e5f29-c9a8-4c5f-9b92-36a1054fcc4b tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 200 len: 1311 microversion: 2.1 time: 0.098154 Aug 02 10:56:11.117645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1229/3042] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:11 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:11.195860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:11.196629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:11.205215 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.213915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.213915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.213915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.245121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.246352 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.246816 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lazy-loading 'fault' on Instance uuid 88583914-a127-4108-9fd8-74a4a6707e47 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:11.272434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-a3d05dca-dac4-487d-a9fe-ad8b17c9f61e req-8343e81b-d0df-484d-98a7-697fd45e4e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daefd063-bf57-4fcd-b586-348ca02fcbcc", "name": "network-vif-deleted", "tag": "127d8a33-053b-4a54-a6c4-64bf7744c528"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:11.283166 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-a3d05dca-dac4-487d-a9fe-ad8b17c9f61e req-8343e81b-d0df-484d-98a7-697fd45e4e94 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:11.283648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-a3d05dca-dac4-487d-a9fe-ad8b17c9f61e req-8343e81b-d0df-484d-98a7-697fd45e4e94 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:11.294428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a800d95ac1d492bb44947fdf5bb3377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ad325d7914771a7e1b66caf2b6e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:11.295321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-a3d05dca-dac4-487d-a9fe-ad8b17c9f61e req-8343e81b-d0df-484d-98a7-697fd45e4e94 service nova] Creating event network-vif-deleted:127d8a33-053b-4a54-a6c4-64bf7744c528 for instance daefd063-bf57-4fcd-b586-348ca02fcbcc on hv-cinder-84753 Aug 02 10:56:11.300078 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-a3d05dca-dac4-487d-a9fe-ad8b17c9f61e req-8343e81b-d0df-484d-98a7-697fd45e4e94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Aug 02 10:56:11.300671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1230/3043] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:11.302537 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-cfd38029-e20c-4e3a-a241-da053e7d70c4 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 200 len: 1308 microversion: 2.1 time: 0.111150 Aug 02 10:56:11.303219 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1814/3044] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:11 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:12.153495 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:12.154195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: daefd063-bf57-4fcd-b586-348ca02fcbcc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:12.160473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.160919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.161672 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.162104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.175055 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] HTTP exception thrown: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Request method failure captured: Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc HTTP/1.1 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6Pr-YuSV8EmiarMytCsYIQw9s-ZwZjpts3cJApP1ExVa1cVMs-RDQACke3bDKaptR--W5K--o6ogrOk6WIaYLqWZodgRsnnw-J816cH_ABwXpjKxgYJXltwbxOjH9qez0OX_orOCdtHKxlkK5TO5sOyvuD7wtToRVUkL1UKttKui9TA Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:12.176697 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fe6c2dfb82174a5692a746ea51769a94", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 9e50546af342492b9b6f6127b0ce2c61 Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. Aug 02 10:56:12.178529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'daefd063-bf57-4fcd-b586-348ca02fcbcc'} Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:12.179656 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. Aug 02 10:56:12.181632 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.183681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Returning 404 to user: Instance daefd063-bf57-4fcd-b586-348ca02fcbcc could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:12.183681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-37a07b5f-94d4-4f12-8875-929a310a0ab9 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc" status: 404 len: 111 microversion: 2.1 time: 0.028845 Aug 02 10:56:12.183681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1231/3045] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:12 2022] GET /compute/v2.1/servers/daefd063-bf57-4fcd-b586-348ca02fcbcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:12.187894 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:12.188386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:12.194321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.194762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.195529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.195958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.324920 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:12.325577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] [instance: 88583914-a127-4108-9fd8-74a4a6707e47] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:12.332438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.332894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.333674 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.334109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.348382 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] HTTP exception thrown: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Request method failure captured: Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 HTTP/1.1 Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PrxWg60T-2AbXZ4W4UGvaL7X_yZpRU0-CqiZAzVpV_Fp0mM97FlmyyaIhShJgbFF1wiJG26YX-2GFltgd9w1huk3APICzSXVbCJC2OvgJj77oePbbBIwrFSH_lr6tpbu2G0g3SmtG1YPNG9c8IoS3Fqihtj64rfF87gyaRSNRu7I9k Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:12.349973 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/356ad325d7914771a7e1b66caf2b6e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_356ad325d7914771a7e1b66caf2b6e4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 356ad325d7914771a7e1b66caf2b6e4d Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-424704666 Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 1a800d95ac1d492bb44947fdf5bb3377 Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-424704666-project Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. Aug 02 10:56:12.351883 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '88583914-a127-4108-9fd8-74a4a6707e47'} Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:12.352914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. Aug 02 10:56:12.354575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:12.355913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] Returning 404 to user: Instance 88583914-a127-4108-9fd8-74a4a6707e47 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:12.355913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7367f63-61fe-4f0d-bcc0-6182c13e8b30 tempest-VolumesSnapshotTestJSON-424704666 tempest-VolumesSnapshotTestJSON-424704666-project] 10.222.0.49 "GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47" status: 404 len: 111 microversion: 2.1 time: 0.031154 Aug 02 10:56:12.358011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1232/3046] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:12 2022] GET /compute/v2.1/servers/88583914-a127-4108-9fd8-74a4a6707e47 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:56:12.370446 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:56:12.737662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8152c0c7-b63f-4545-9036-afaf41d52779 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 204 len: 0 microversion: 2.1 time: 0.553249 Aug 02 10:56:12.738300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1815/3047] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:12 2022] DELETE /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:56:12.747455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:12.748100 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:12.754139 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.754585 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.755365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:12.755793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:12.896698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:12.905206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb374597-8dac-4854-ab81-96db043b60a7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1522 microversion: 2.1 time: 0.162278 Aug 02 10:56:12.905797 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1233/3048] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:12 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:13.770762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-67806e11-8bb9-48d9-9572-ac5c7ad56e8b req-2cfa010c-29cd-42d8-af3d-39fde62289b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8132ed-8e07-4258-b20b-a0dbcb53bd48", "name": "network-vif-deleted", "tag": "248b1799-6c6f-4c3a-9470-fb8512e2f279"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:13.785977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-67806e11-8bb9-48d9-9572-ac5c7ad56e8b req-2cfa010c-29cd-42d8-af3d-39fde62289b4 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:13.786496 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-67806e11-8bb9-48d9-9572-ac5c7ad56e8b req-2cfa010c-29cd-42d8-af3d-39fde62289b4 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:13.805626 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-67806e11-8bb9-48d9-9572-ac5c7ad56e8b req-2cfa010c-29cd-42d8-af3d-39fde62289b4 service nova] Creating event network-vif-deleted:248b1799-6c6f-4c3a-9470-fb8512e2f279 for instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 on hv-cinder-84753 Aug 02 10:56:13.814588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-67806e11-8bb9-48d9-9572-ac5c7ad56e8b req-2cfa010c-29cd-42d8-af3d-39fde62289b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050405 Aug 02 10:56:13.815266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1816/3049] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:13.926309 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:13.927619 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:13.930011 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:13.939474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:13.939744 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:13.940286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:13.940721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:14.005397 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e50546af342492b9b6f6127b0ce2c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe6c2dfb82174a5692a746ea51769a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:14.013913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f58fe53f-5ba2-4672-a718-d6600dcf9fd7 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 200 len: 1480 microversion: 2.1 time: 0.091655 Aug 02 10:56:14.016774 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1234/3050] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:13 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 1480 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:15.036573 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:15.037275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] [instance: 8b8132ed-8e07-4258-b20b-a0dbcb53bd48] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:15.039252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:15.044197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:15.044650 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:15.045421 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:15.045968 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:15.060065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] HTTP exception thrown: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Request method failure captured: Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 HTTP/1.1 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6Pr-YuSV8EmiarMytCsYIQw9s-ZwZjpts3cJApP1ExVa1cVMs-RDQACke3bDKaptR--W5K--o6ogrOk6WIaYLqWZodgRsnnw-J816cH_ABwXpjKxgYJXltwbxOjH9qez0OX_orOCdtHKxlkK5TO5sOyvuD7wtToRVUkL1UKttKui9TA Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:56:15.063682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe6c2dfb82174a5692a746ea51769a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fe6c2dfb82174a5692a746ea51769a94", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: fe6c2dfb82174a5692a746ea51769a94 Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1185281559 Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 9e50546af342492b9b6f6127b0ce2c61 Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1185281559-project Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. Aug 02 10:56:15.065703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '8b8132ed-8e07-4258-b20b-a0dbcb53bd48'} Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:15.066745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. Aug 02 10:56:15.068589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:15.070040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] Returning 404 to user: Instance 8b8132ed-8e07-4258-b20b-a0dbcb53bd48 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:15.070040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-71931ead-378a-4aec-b543-642a3040fac0 tempest-ServerRescueNegativeTestJSON-1185281559 tempest-ServerRescueNegativeTestJSON-1185281559-project] 10.222.0.49 "GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48" status: 404 len: 111 microversion: 2.1 time: 0.031381 Aug 02 10:56:15.070040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1817/3051] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:15 2022] GET /compute/v2.1/servers/8b8132ed-8e07-4258-b20b-a0dbcb53bd48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:56:20.194266 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:20.195925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:20.205031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:20.205650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:20.206639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:20.207101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:20.305048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lazy-loading 'services' on Instance uuid e4183b2e-fe28-46ad-afa8-b54b4664788c {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:20.548409 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2c32d71c-cabf-4a4d-bee6-4af3f2e4609b tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments/320b84ea-12e7-458f-a521-fe535189d323" status: 202 len: 0 microversion: 2.1 time: 0.358487 Aug 02 10:56:20.550990 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1235/3052] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:56:20 2022] DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments/320b84ea-12e7-458f-a521-fe535189d323 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:56:20.558789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:20.561556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:20.577392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:20.578107 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:20.581386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:20.581386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:20.611581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bc500991-8672-467f-8c00-2feb782a2292 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057792 Aug 02 10:56:20.612245 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1818/3053] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:56:20 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:21.625952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:21.628339 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:21.635470 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.636031 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.637418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.637902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.658704 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:21.682384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f51d917b-89e7-4006-ba4f-ccbc967e9259 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061575 Aug 02 10:56:21.682991 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1236/3054] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:56:21 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 10:56:21.747069 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:21.747767 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:21.754740 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.755213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.755984 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.756417 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.785246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:56:22.091412 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fec4e7be-bc17-4575-a93b-5f677880eac4 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 204 len: 0 microversion: 2.1 time: 0.348697 Aug 02 10:56:22.092093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1819/3055] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:21 2022] DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:56:22.100877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:22.101506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:22.109236 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:22.109687 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:22.110471 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:22.110907 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:22.304564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:22.321223 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-78db3980-d73f-4582-828f-0190d08fd71e tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1682 microversion: 2.1 time: 0.224039 Aug 02 10:56:22.322180 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1237/3056] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:22 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:23.345950 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:23.346640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:23.353684 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:23.354380 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:23.355783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:23.356216 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:23.770686 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:23.784980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8fb7c24b-9731-475d-998e-7c1418b822b3 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1682 microversion: 2.1 time: 0.442641 Aug 02 10:56:23.786168 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1820/3057] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:23 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1682 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:24.811405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:24.812363 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:24.819457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:24.820057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:24.820952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:24.821491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:24.994663 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:25.005142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5fd3972d-b7cb-4136-bb80-ec18f40a6f39 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1682 microversion: 2.1 time: 0.198811 Aug 02 10:56:25.005855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1238/3058] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:24 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:25.941213 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-3572eb3f-e4ac-4034-86ef-e35455d5b958 req-18a4fac8-6969-4c05-ac63-15dacb25a60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4183b2e-fe28-46ad-afa8-b54b4664788c", "name": "network-vif-deleted", "tag": "d18e2c9a-4f8a-4ddc-b96e-d319944daeb0"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:25.970467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-3572eb3f-e4ac-4034-86ef-e35455d5b958 req-18a4fac8-6969-4c05-ac63-15dacb25a60e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:25.970924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-3572eb3f-e4ac-4034-86ef-e35455d5b958 req-18a4fac8-6969-4c05-ac63-15dacb25a60e service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:25.992768 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-3572eb3f-e4ac-4034-86ef-e35455d5b958 req-18a4fac8-6969-4c05-ac63-15dacb25a60e service nova] Creating event network-vif-deleted:d18e2c9a-4f8a-4ddc-b96e-d319944daeb0 for instance e4183b2e-fe28-46ad-afa8-b54b4664788c on hv-cinder-84753 Aug 02 10:56:26.001694 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-3572eb3f-e4ac-4034-86ef-e35455d5b958 req-18a4fac8-6969-4c05-ac63-15dacb25a60e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068373 Aug 02 10:56:26.003128 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1821/3059] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:26.036072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:26.037420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:26.046375 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:26.046984 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:26.047977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:26.048696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:26.121508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:26.131647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4ede030a-18f7-4551-a709-fb3ec8adbd3d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1614 microversion: 2.1 time: 0.101853 Aug 02 10:56:26.131647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1239/3060] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:26 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1614 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:27.154680 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:27.155416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:27.162521 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:27.162976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:27.163832 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:27.164281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:27.261993 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:27.275486 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:27.279250 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bde56b7a-98d0-4399-af01-baee1424ce83 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1614 microversion: 2.1 time: 0.129415 Aug 02 10:56:27.280625 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1822/3061] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:27 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1614 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:28.301447 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:28.302702 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:28.310110 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.310869 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.311971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.312735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.368681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.369715 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.370921 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lazy-loading 'fault' on Instance uuid e4183b2e-fe28-46ad-afa8-b54b4664788c {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:28.438486 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ee2b6dd6f647179d2af999b3e62788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc1c45a26e84a3bbc06d52fec42e332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:28.449344 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4af5e05-b16f-4cb2-9744-99fd844e24c8 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 200 len: 1331 microversion: 2.1 time: 0.151283 Aug 02 10:56:28.463812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1240/3062] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:28 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:28.883693 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-dbc19c72-f817-432d-afcf-78148622ec51 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: .version_select at 0x7f70cb471430>, body: {"keypair": {"name": "tempest-keypair-1737431769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Z8idw0qtZbUPjz1siavo0IVmQupCQqktSlCSXiyU72Q/gqH1XhyVszG5UYa0jtoqAHKYFVcv5c5QVCj4onPVgIEqY8fITvmn3JB9qJBWguMwvBf8NInSLS+KzfAPjbA=="}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:28.901076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dbc19c72-f817-432d-afcf-78148622ec51 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for project 886baa7c44f641d287f911a81bebaa13. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:28.904842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-dbc19c72-f817-432d-afcf-78148622ec51 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for user 89de93e6f9564e2cb73500e3d383e836 and project 886baa7c44f641d287f911a81bebaa13. Resources: {'key_pairs'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:28.996708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-dbc19c72-f817-432d-afcf-78148622ec51 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175297 Aug 02 10:56:28.996708 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1823/3063] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:56:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:29.471405 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:29.472383 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:29.479386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:29.479982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:29.480639 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:29.481068 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:29.497927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c HTTP/1.1 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:29.499717 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:29.501622 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'e4183b2e-fe28-46ad-afa8-b54b4664788c'} Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:29.502684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:29.506818 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:29.510575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:29.510575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-94f32d17-be27-4ae4-b673-5d4ae0ae8083 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 404 len: 111 microversion: 2.1 time: 0.033826 Aug 02 10:56:29.510575 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1241/3064] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:29 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:56:29.515121 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de4638e4-3861-4401-9bdc-27769245fa73 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '.version_select at 0x7f70cb46eb80>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:29.600501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de4638e4-3861-4401-9bdc-27769245fa73 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857297968" status: 202 len: 0 microversion: 2.1 time: 0.092141 Aug 02 10:56:29.601188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1824/3065] 10.222.0.49 () {58 vars in 1221 bytes} [Tue Aug 2 10:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857297968 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:56:32.006893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:32.007606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:32.019036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.020205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.022212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.023528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.049415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c HTTP/1.1 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:32.051794 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.053517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'e4183b2e-fe28-46ad-afa8-b54b4664788c'} Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:32.054406 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.055896 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.062964 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:32.073047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0a6168a0-df5c-4e54-b4c1-869d3edda749 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 404 len: 111 microversion: 2.1 time: 0.070239 Aug 02 10:56:32.078795 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1242/3066] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:32 2022] DELETE /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:32.095582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:32.104272 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: e4183b2e-fe28-46ad-afa8-b54b4664788c] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:32.126141 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.127296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.128277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.128885 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.149571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c HTTP/1.1 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:56:32.153087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.155026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'e4183b2e-fe28-46ad-afa8-b54b4664788c'} Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:32.156076 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. Aug 02 10:56:32.157749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:32.159333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance e4183b2e-fe28-46ad-afa8-b54b4664788c could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:32.162129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d230ce61-ce2d-4c85-82ca-083ada8d5aa9 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c" status: 404 len: 111 microversion: 2.1 time: 0.069634 Aug 02 10:56:32.174297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1825/3067] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:32 2022] GET /compute/v2.1/servers/e4183b2e-fe28-46ad-afa8-b54b4664788c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:32.644474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1082164415", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d860e69-11b5-4728-87bc-53cf179a69f3"}], "security_groups": [{"name": "tempest-securitygroup--1915929742"}], "key_name": "tempest-keypair-1737431769", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:32.765505 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] validate_networks() for [('9d860e69-11b5-4728-87bc-53cf179a69f3', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:56:33.218633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:56:33.219257 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:56:33.219557 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:56:33.219970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:56:33.220384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:56:33.229960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.230408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.232234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.232234 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.250315 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for project 886baa7c44f641d287f911a81bebaa13. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:33.254524 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for user 89de93e6f9564e2cb73500e3d383e836 and project 886baa7c44f641d287f911a81bebaa13. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:33.267177 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:56:33.269553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:56:33.503832 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a4e4a60-ab43-49c0-8c27-b76192f00e15 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.863434 Aug 02 10:56:33.504695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1243/3068] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:56:33.516907 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-62ca9ac2-08fc-4d2a-92d4-cb6a227bcede tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.517526 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-62ca9ac2-08fc-4d2a-92d4-cb6a227bcede tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.570596 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.570958 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.579093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.579587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.580379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.581034 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.598220 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-62ca9ac2-08fc-4d2a-92d4-cb6a227bcede tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:33.599876 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 HTTP/1.1 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:33.602181 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.604021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '015594f3-0995-434f-b0b2-e79e4f7a8a77'} Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:33.605580 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.607576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.609309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-62ca9ac2-08fc-4d2a-92d4-cb6a227bcede tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1238 microversion: 2.1 time: 0.094484 Aug 02 10:56:33.609309 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1826/3069] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:33 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:33.609971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:33.610974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4765cfa-92de-4c76-b28c-ee940f2ec782 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 404 len: 111 microversion: 2.1 time: 0.045681 Aug 02 10:56:33.611572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1244/3070] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:33 2022] DELETE /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:56:33.627298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.628118 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: 015594f3-0995-434f-b0b2-e79e4f7a8a77] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.639055 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.639538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.640316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.640753 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.655117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 HTTP/1.1 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:56:33.656663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.658282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '015594f3-0995-434f-b0b2-e79e4f7a8a77'} Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:33.659810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. Aug 02 10:56:33.661428 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.662759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance 015594f3-0995-434f-b0b2-e79e4f7a8a77 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:33.662759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-748b32fe-9ab0-4cb8-8035-6f4440f2508d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77" status: 404 len: 111 microversion: 2.1 time: 0.035484 Aug 02 10:56:33.662759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1827/3071] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:33 2022] GET /compute/v2.1/servers/015594f3-0995-434f-b0b2-e79e4f7a8a77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:33.668381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.668962 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.678205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.678205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.678205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.678205 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.692009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc HTTP/1.1 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:56:33.693582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.695562 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'da557b6b-b710-411d-94ef-d1d2a2bde8cc'} Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:33.696836 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.698696 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.700379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:33.700379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7c0f5bb0-7688-4021-9cfe-79b6df4f94a7 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 404 len: 111 microversion: 2.1 time: 0.031785 Aug 02 10:56:33.700379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1245/3072] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:56:33 2022] DELETE /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:33.705958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.706581 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: da557b6b-b710-411d-94ef-d1d2a2bde8cc] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.713325 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.713699 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.714494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.714996 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.728748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc HTTP/1.1 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 10:56:33.737301 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.739234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'da557b6b-b710-411d-94ef-d1d2a2bde8cc'} Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:33.740468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. Aug 02 10:56:33.742142 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 10:56:33.744378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance da557b6b-b710-411d-94ef-d1d2a2bde8cc could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:33.744378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-349b6c05-be1c-4988-9ad5-b2ab6411306d tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc" status: 404 len: 111 microversion: 2.1 time: 0.030352 Aug 02 10:56:33.744378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1828/3073] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:33 2022] GET /compute/v2.1/servers/da557b6b-b710-411d-94ef-d1d2a2bde8cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:34.629029 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4ecd33b-b4ec-430d-9cd7-04a848f6692c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:34.629569 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4ecd33b-b4ec-430d-9cd7-04a848f6692c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:34.687658 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4ecd33b-b4ec-430d-9cd7-04a848f6692c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:34.703974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4ecd33b-b4ec-430d-9cd7-04a848f6692c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1238 microversion: 2.1 time: 0.078803 Aug 02 10:56:34.704735 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1246/3074] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:34 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:35.725562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:35.726407 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:35.733125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.733572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.734425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.734856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.804974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:35.814161 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c819a5e2-0420-41d4-a971-b0a6ae38591d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1290 microversion: 2.1 time: 0.092545 Aug 02 10:56:35.814733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1829/3075] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:35 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:36.842857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:36.844536 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:36.854179 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:36.857185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:36.857185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:36.857185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:36.926944 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:36.935746 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2eb04a67-b0ed-4ce1-a98a-c8ef90203894 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1308 microversion: 2.1 time: 0.098808 Aug 02 10:56:36.936508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1247/3076] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:36 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:37.957050 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:37.957730 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:37.964478 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:37.964917 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:37.965697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:37.966131 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:38.194908 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:38.202612 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-83326c0e-1995-4b5f-bd25-c19cf10368ae tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.249351 Aug 02 10:56:38.203211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1830/3077] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:37 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:38.396412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-45a26c94-02d8-45d6-9cc2-40abafe68957 req-cecd4c45-a7d6-4413-bce4-c09929f341cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc81574c-6e3f-48bc-b74b-bf5097dd340a", "tag": "bf007958-7b3f-4f0a-ac36-3fd59ec42e8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:38.407793 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-45a26c94-02d8-45d6-9cc2-40abafe68957 req-cecd4c45-a7d6-4413-bce4-c09929f341cb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:38.408323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-45a26c94-02d8-45d6-9cc2-40abafe68957 req-cecd4c45-a7d6-4413-bce4-c09929f341cb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:38.420952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-45a26c94-02d8-45d6-9cc2-40abafe68957 req-cecd4c45-a7d6-4413-bce4-c09929f341cb service nova] Creating event network-changed:bf007958-7b3f-4f0a-ac36-3fd59ec42e8e for instance bc81574c-6e3f-48bc-b74b-bf5097dd340a on hv-cinder-84753 Aug 02 10:56:38.426109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-45a26c94-02d8-45d6-9cc2-40abafe68957 req-cecd4c45-a7d6-4413-bce4-c09929f341cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034354 Aug 02 10:56:38.426823 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1248/3078] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:39.228230 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:39.228796 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:39.236475 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:39.236923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:39.237702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:39.238145 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:39.370369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:39.377921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-70b27bb4-c9fb-4379-aaf5-cc93186617e3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.155691 Aug 02 10:56:39.378477 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1831/3079] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:39 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:40.401297 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:40.402457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:40.409381 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.409830 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:40.410612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.411048 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:40.541516 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:40.549863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-690171fc-862e-450f-8a70-1c0b516ead4f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.153936 Aug 02 10:56:40.550438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1249/3080] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:40 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:41.570068 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:41.570779 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:41.577647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:41.578094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:41.578899 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:41.579366 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:41.713465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:41.721717 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b162a673-77ef-48b5-a715-23e9e3224053 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.155602 Aug 02 10:56:41.722287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1832/3081] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:41 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:42.744599 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:42.745255 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:42.752517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.752960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.753727 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.754156 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.886942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:42.896036 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ebf97349-1e27-4764-b0ac-422c314c82f7 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.155370 Aug 02 10:56:42.900565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1250/3082] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:42 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:43.851943 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:43.919026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:43.919684 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:43.919788 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-a806c0f0-b725-4c4b-a981-577f2a07dc1f req-9c569c3b-3165-4013-8b9d-a8adffceddbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc81574c-6e3f-48bc-b74b-bf5097dd340a", "name": "network-vif-plugged", "status": "completed", "tag": "bf007958-7b3f-4f0a-ac36-3fd59ec42e8e"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:43.922970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:43.928857 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.929357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.930121 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.930554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.931174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-a806c0f0-b725-4c4b-a981-577f2a07dc1f req-9c569c3b-3165-4013-8b9d-a8adffceddbb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.931648 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-a806c0f0-b725-4c4b-a981-577f2a07dc1f req-9c569c3b-3165-4013-8b9d-a8adffceddbb service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.944087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-a806c0f0-b725-4c4b-a981-577f2a07dc1f req-9c569c3b-3165-4013-8b9d-a8adffceddbb service nova] Creating event network-vif-plugged:bf007958-7b3f-4f0a-ac36-3fd59ec42e8e for instance bc81574c-6e3f-48bc-b74b-bf5097dd340a on hv-cinder-84753 Aug 02 10:56:43.950771 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-a806c0f0-b725-4c4b-a981-577f2a07dc1f req-9c569c3b-3165-4013-8b9d-a8adffceddbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103735 Aug 02 10:56:43.951395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1833/3083] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:44.106721 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:44.114739 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0040888d-1f95-4c29-b532-aa109a8bc08d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.199839 Aug 02 10:56:44.122691 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1251/3084] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:43 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:45.152368 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:45.153253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:45.161501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.162001 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:45.163015 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.163776 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:45.297530 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:45.305338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-f0ec2f6e-4d12-4c50-9f0b-153a7d900147 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1364 microversion: 2.1 time: 0.159179 Aug 02 10:56:45.307886 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1834/3085] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:45 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:46.327825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:46.328437 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:46.330627 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:46.336510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:46.340441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:46.340441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:46.340441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:46.481597 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:46.489442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4eab70ec-7cd4-40d2-b490-de927a3e9a88 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1550 microversion: 2.1 time: 0.166128 Aug 02 10:56:46.490003 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1252/3086] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:56:46 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:46.510144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:46.510795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:46.517386 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:46.517866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:46.518646 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:46.519083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:46.604494 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c80699a9-fe14-4004-a1da-3993963ea44b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098305 Aug 02 10:56:46.605200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1835/3087] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:56:46 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:48.086480 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-47b93500-9d30-4b90-bbf4-c32570a1a0bf req-0c5f6f4b-99ce-4d58-9493-91419f07f910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc81574c-6e3f-48bc-b74b-bf5097dd340a", "tag": "bf007958-7b3f-4f0a-ac36-3fd59ec42e8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:48.104549 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-47b93500-9d30-4b90-bbf4-c32570a1a0bf req-0c5f6f4b-99ce-4d58-9493-91419f07f910 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:48.105675 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-47b93500-9d30-4b90-bbf4-c32570a1a0bf req-0c5f6f4b-99ce-4d58-9493-91419f07f910 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:48.119517 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-47b93500-9d30-4b90-bbf4-c32570a1a0bf req-0c5f6f4b-99ce-4d58-9493-91419f07f910 service nova] Creating event network-changed:bf007958-7b3f-4f0a-ac36-3fd59ec42e8e for instance bc81574c-6e3f-48bc-b74b-bf5097dd340a on hv-cinder-84753 Aug 02 10:56:48.125123 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-47b93500-9d30-4b90-bbf4-c32570a1a0bf req-0c5f6f4b-99ce-4d58-9493-91419f07f910 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250726 Aug 02 10:56:48.125659 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1253/3088] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:24.140389 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:24.141135 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=43 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:24.145016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:24.145729 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:24.152017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.157084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.157084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.157084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.177185 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-40a6fbc9-c40f-4b50-9424-2123e178b030 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/ips" status: 200 len: 146 microversion: 2.1 time: 0.038477 Aug 02 10:57:24.177739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1836/3089] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 10:57:24 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:27.310442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34337174-e6a3-492d-9e7e-9558243833ec"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:27.312923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:27.315041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:27.315886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=73 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:27.320636 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.321083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:27.321843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.322274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.007408 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0ffc9314-55f4-4f9c-b936-c4314a63e3a9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701806 Aug 02 10:57:28.008104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1254/3090] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 10:57:27 2022] POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:35.555826 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-286eb7f2-e3df-4ed4-967e-c52ca53790de tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:35.564468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-286eb7f2-e3df-4ed4-967e-c52ca53790de tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.564936 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-286eb7f2-e3df-4ed4-967e-c52ca53790de tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.631371 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-286eb7f2-e3df-4ed4-967e-c52ca53790de tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Going to try to stop instance {{(pid=118452) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:57:35.895854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-286eb7f2-e3df-4ed4-967e-c52ca53790de tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action" status: 202 len: 0 microversion: 2.1 time: 0.344654 Aug 02 10:57:35.896585 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1837/3091] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:57:35 2022] POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:57:35.906274 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:35.906866 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:35.914358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.918499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.918499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.918499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.050057 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:36.058300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-31480a52-160f-4027-abb5-f7f27f50f13c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.156971 Aug 02 10:57:36.058897 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1255/3092] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:35 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:37.081378 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:37.082000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:37.088485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.089005 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.089791 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.090229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.225969 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.234618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1e168782-d885-4929-a2af-64681f9631e5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.157568 Aug 02 10:57:37.235178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1838/3093] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:37 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:38.255267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:38.256041 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:38.262771 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.263230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.264587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.265059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.405891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:38.414212 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cbb7e12b-bcc4-4df3-a032-6d46761d5309 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.162848 Aug 02 10:57:38.414784 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1256/3094] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:38 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:39.437447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:39.438017 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:39.444498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.444946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.445712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.446147 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.580024 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:39.588202 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-948156db-489b-43d2-b094-cfffb7745ec9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.155316 Aug 02 10:57:39.588615 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1839/3095] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:39 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:40.609757 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:40.610421 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:40.617254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.617705 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.618482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.618919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.749478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.757686 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e8f3c3a-0fb8-4b02-9b0e-7fea0fe52292 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.151965 Aug 02 10:57:40.758348 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1257/3096] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:40 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:41.780316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:41.780942 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:41.787658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.788039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.788804 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.789238 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.923330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.931307 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2f45271f-c735-4123-a2be-ba4ce3e2733b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.154785 Aug 02 10:57:41.932062 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1840/3097] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:41 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:42.954725 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:42.955432 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:42.962226 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.962701 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.968579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.968579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.092415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:43.100401 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-749e1b3f-e0fc-441a-8a6f-6830f3e424ad tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.150869 Aug 02 10:57:43.100959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1258/3098] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:42 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:44.121976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:44.122538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:44.128949 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.129396 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.130164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.130592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.262211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:44.270651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e89b0588-1159-40e1-ac39-7b46028f661b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.152649 Aug 02 10:57:44.271237 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1841/3099] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:44 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:45.292886 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:45.293508 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:45.301001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.301453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.302229 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.302664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.435571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.444109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4ede976c-3dbb-4391-893c-bb306a2c190c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.155491 Aug 02 10:57:45.444668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1259/3100] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:45 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:46.465473 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:46.466798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:46.473640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:46.474156 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:46.474937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:46.475425 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:46.632720 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:46.641044 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-667a18be-0152-4d33-b62d-80a1c5d1046b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1725 microversion: 2.1 time: 0.179638 Aug 02 10:57:46.641672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1842/3101] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:46 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:47.663200 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:47.663835 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:47.670367 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.670799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.671655 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.672018 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.803294 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.811232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-23296b61-ca3f-4caf-aa78-5bcb0ebba093 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1702 microversion: 2.1 time: 0.151963 Aug 02 10:57:47.811788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1260/3102] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:47 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1702 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:47.832436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9765d897-2f54-4812-8b5e-edef7b1bf09e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:47.839040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9765d897-2f54-4812-8b5e-edef7b1bf09e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.839514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9765d897-2f54-4812-8b5e-edef7b1bf09e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.861287 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9765d897-2f54-4812-8b5e-edef7b1bf09e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Going to try to start instance {{(pid=118452) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:57:48.040293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9765d897-2f54-4812-8b5e-edef7b1bf09e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action" status: 202 len: 0 microversion: 2.1 time: 0.211486 Aug 02 10:57:48.041490 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1843/3103] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:57:47 2022] POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:57:48.068582 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:48.069514 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:48.075825 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.076279 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.077058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.077491 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.215026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.229105 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b05ab576-b647-45c1-ab4a-5b08959b3916 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1711 microversion: 2.1 time: 0.182963 Aug 02 10:57:48.229692 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1261/3104] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:48 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:49.253676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:49.254391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:49.261026 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:49.261485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:49.262281 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:49.262725 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:49.410367 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:49.418361 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b5efea7d-e18e-47a9-8d24-1fff99c41bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1711 microversion: 2.1 time: 0.170142 Aug 02 10:57:49.418911 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1844/3105] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:49 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:50.439839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:50.440453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:50.447303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:50.447748 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:50.448510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:50.448941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:50.580358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:50.588762 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a884d22-2169-459f-ac17-a8a2862e74ea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1715 microversion: 2.1 time: 0.152887 Aug 02 10:57:50.589321 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1262/3106] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:57:50 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:55.983108 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:57:55.983680 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:58:02.182924 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:58:02.183582 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 10:58:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:58:23.831099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:23.831829 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:23.833939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=18 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:23.834601 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:23.839580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:23.840028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:23.840803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:23.841241 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:23.923669 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lazy-loading 'services' on Instance uuid bc81574c-6e3f-48bc-b74b-bf5097dd340a {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:58:24.327961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2406c011-c8a3-4082-9372-b22ee6219416 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments/34337174-e6a3-492d-9e7e-9558243833ec" status: 202 len: 0 microversion: 2.1 time: 0.500635 Aug 02 10:58:24.328556 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1845/3107] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 10:58:23 2022] DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments/34337174-e6a3-492d-9e7e-9558243833ec => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:25.473233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-41e4892d-a1d6-4bf8-821d-62dc9a7ef532 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:25.476259 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=18 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:25.476941 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:25.482012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41e4892d-a1d6-4bf8-821d-62dc9a7ef532 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.482462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41e4892d-a1d6-4bf8-821d-62dc9a7ef532 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.547312 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-41e4892d-a1d6-4bf8-821d-62dc9a7ef532 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Going to try to stop instance {{(pid=118453) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:58:25.828138 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-41e4892d-a1d6-4bf8-821d-62dc9a7ef532 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action" status: 202 len: 0 microversion: 2.1 time: 0.359432 Aug 02 10:58:25.828778 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1263/3108] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:58:25 2022] POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:58:25.838695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:25.839458 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:25.845814 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.846260 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.847028 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.847514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.984489 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:25.992676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3d561b8d-e272-4b2d-9568-4b5225369c3f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.159229 Aug 02 10:58:25.993252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1846/3109] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:25 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:27.014695 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:27.015415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:27.022059 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:27.022499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:27.023291 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:27.023723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:27.218005 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:27.226713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee9f866e-b9c0-4082-ac82-6565554b8bdb tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.216657 Aug 02 10:58:27.227567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1264/3110] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:27 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:28.248373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:28.248997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:28.255580 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:28.256097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:28.257369 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:28.257803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:28.386059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:28.393480 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9572b0d5-e654-401f-a9ca-5ff4aba5c658 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.149085 Aug 02 10:58:28.394036 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1847/3111] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:28 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:29.414593 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:29.415230 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:29.422415 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.423090 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.423953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.424462 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.552160 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:29.562623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4546c7dd-9010-4103-a0e1-ae731f4df27f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.149933 Aug 02 10:58:29.562623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1265/3112] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:29 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:30.582116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:30.582726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:30.589240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:30.589679 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:30.590436 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:30.590862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:30.723016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:30.731079 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-324c2330-1193-4680-9c4b-5d07750c6c63 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.152850 Aug 02 10:58:30.731676 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1848/3113] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:30 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:31.752937 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:31.753555 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:31.760781 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.761231 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.761992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.762433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.887422 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:31.894821 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-45c62670-45b6-48f1-9025-242f1b81ccc8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.145842 Aug 02 10:58:31.895403 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1266/3114] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:31 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:32.916827 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:32.917470 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:32.923789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:32.924239 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:32.925000 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:32.925432 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:33.141874 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:33.149406 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bd8ebea9-f90a-4f4b-8838-0c5952337a8a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.236808 Aug 02 10:58:33.149976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1849/3115] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:32 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:34.171537 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:34.172151 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:34.178664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:34.179206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:34.179988 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:34.180429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:34.314356 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:34.322506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-308328b2-1f15-4d65-8559-3b3a001e785d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.154953 Aug 02 10:58:34.323075 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1267/3116] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:34 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:35.344148 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:35.344822 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:35.352029 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.352479 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.353249 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.353698 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.487921 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:35.495555 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-78bf359d-3d7d-4da8-b539-65f7e9a6a10e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1679 microversion: 2.1 time: 0.155276 Aug 02 10:58:35.496117 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1850/3117] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:35 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:36.517253 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:36.517842 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:36.524919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.525396 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.526153 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.526577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.656783 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:36.664316 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46a981da-100d-40a6-8c56-5a0f07d8035c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1656 microversion: 2.1 time: 0.150966 Aug 02 10:58:36.664868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1268/3118] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:36 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:36.685013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-7967f714-f9ef-4fc3-94b4-d0bab83d801b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:36.691872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7967f714-f9ef-4fc3-94b4-d0bab83d801b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.692321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-7967f714-f9ef-4fc3-94b4-d0bab83d801b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.715485 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-7967f714-f9ef-4fc3-94b4-d0bab83d801b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Going to try to start instance {{(pid=118452) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:58:36.929542 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-7967f714-f9ef-4fc3-94b4-d0bab83d801b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action" status: 202 len: 0 microversion: 2.1 time: 0.248268 Aug 02 10:58:36.930174 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1851/3119] 10.222.0.49 () {60 vars in 1278 bytes} [Tue Aug 2 10:58:36 2022] POST /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:36.938350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:36.938996 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:36.945759 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.946206 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.946982 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.947451 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.080788 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:37.088439 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-696f1900-6ab8-4ab7-9dd3-0d040c5e02a4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1665 microversion: 2.1 time: 0.153975 Aug 02 10:58:37.089007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1269/3120] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:36 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:38.110799 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:38.111536 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:38.118034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.118481 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.119282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.119724 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.250297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:38.258532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fe2cfcc8-19f1-4810-9efd-72f8374b08c3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1665 microversion: 2.1 time: 0.152497 Aug 02 10:58:38.259097 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1852/3121] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:38 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:39.280054 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:39.280667 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:39.287099 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.287579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.288912 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.289349 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.418456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:39.426473 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-931c5143-9122-46b7-91c7-8e690c6f3cf0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1669 microversion: 2.1 time: 0.150558 Aug 02 10:58:39.427044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1270/3122] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:58:39 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:12.606766 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:12.609049 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:12.611302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=16 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:12.611973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:12.616833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:12.617286 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:12.618263 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:12.618706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:12.649423 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8b9dc7f4-7f3d-4a8d-88d4-ba8a449b188b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047218 Aug 02 10:59:12.650164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1853/3123] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 10:59:12 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:59:12.715924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:12.716527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:12.718681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=16 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:12.719547 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:12.724509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:12.731254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:12.731254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:12.731254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:12.752564 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:59:13.099040 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-facb3c72-2418-4bdd-b8e9-77c145f91020 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 204 len: 0 microversion: 2.1 time: 0.386742 Aug 02 10:59:13.099522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1271/3124] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 10:59:12 2022] DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:59:13.108596 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:13.111157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:13.116973 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:13.117422 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:13.118234 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:13.118673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:13.262576 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:13.271225 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bec8bb80-6f93-4060-8e26-7e75866f3e11 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1675 microversion: 2.1 time: 0.166508 Aug 02 10:59:13.271913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1854/3125] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:13 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:59:14.294410 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:14.295116 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:14.301741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:14.302185 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:14.302957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:14.303428 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:14.434819 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:14.442303 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e192659b-fe1e-43a3-a243-352d21614ad5 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1675 microversion: 2.1 time: 0.152120 Aug 02 10:59:14.442871 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1272/3126] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:14 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:15.464419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:15.465295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:15.472306 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:15.472762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:15.473552 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:15.473997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:15.967550 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:15.975342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0ea5cbf3-2962-4748-b4cb-0b81353ee96b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1675 microversion: 2.1 time: 0.514925 Aug 02 10:59:15.982099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1855/3127] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:15 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1675 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:16.461688 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-c804606c-0183-4f5b-b1d7-bca895b1d582 req-76652fa0-bccd-412b-b6f4-1ffdfd2f8814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc81574c-6e3f-48bc-b74b-bf5097dd340a", "name": "network-vif-deleted", "tag": "bf007958-7b3f-4f0a-ac36-3fd59ec42e8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:16.473083 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c804606c-0183-4f5b-b1d7-bca895b1d582 req-76652fa0-bccd-412b-b6f4-1ffdfd2f8814 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:16.473522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c804606c-0183-4f5b-b1d7-bca895b1d582 req-76652fa0-bccd-412b-b6f4-1ffdfd2f8814 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:16.485429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-c804606c-0183-4f5b-b1d7-bca895b1d582 req-76652fa0-bccd-412b-b6f4-1ffdfd2f8814 service nova] Creating event network-vif-deleted:bf007958-7b3f-4f0a-ac36-3fd59ec42e8e for instance bc81574c-6e3f-48bc-b74b-bf5097dd340a on hv-cinder-84753 Aug 02 10:59:16.490438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-c804606c-0183-4f5b-b1d7-bca895b1d582 req-76652fa0-bccd-412b-b6f4-1ffdfd2f8814 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032549 Aug 02 10:59:16.491043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1273/3128] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:16.998618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:16.999232 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:17.005867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:17.006333 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:17.007288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:17.007543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:17.044259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:17.045065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:17.045657 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lazy-loading 'fault' on Instance uuid bc81574c-6e3f-48bc-b74b-bf5097dd340a {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:59:17.096092 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:17.104483 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b41cc726-2206-4b05-acb4-b42764a6cb47 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 200 len: 1328 microversion: 2.1 time: 0.110351 Aug 02 10:59:17.105264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1856/3129] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:16 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:18.127671 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:18.128366 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:18.134749 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:18.135286 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:18.136049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:18.136476 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:18.149574 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a HTTP/1.1 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 10:59:18.151972 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 10:59:18.154132 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'bc81574c-6e3f-48bc-b74b-bf5097dd340a'} Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:59:18.155125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 10:59:18.156732 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 10:59:18.158542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:59:18.158542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a7b419fa-bbcf-49e1-94ff-70fc7186dd28 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 404 len: 111 microversion: 2.1 time: 0.030491 Aug 02 10:59:18.158542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1274/3130] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:18 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:59:18.162338 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b3719642-381d-4120-b7b0-cca838b92717 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '.version_select at 0x7f70c374d310>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:18.239543 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b3719642-381d-4120-b7b0-cca838b92717 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737431769" status: 202 len: 0 microversion: 2.1 time: 0.080825 Aug 02 10:59:18.240167 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1857/3131] 10.222.0.49 () {58 vars in 1221 bytes} [Tue Aug 2 10:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737431769 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:59:19.048877 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5c4a016f-3e8b-49ca-b49d-68441bb52f70 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: .version_select at 0x7f70cb486040>, body: {"keypair": {"name": "tempest-keypair-1060728753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPjbZOdjQhRDfNwlQN+TFPJAO7QRkDsfIuUzs9m4zcLIQVDWTey/bTIfb/rcT4xDOo+Ci02PHKh92CeAu6XQIQw0sXWUrFxd29QVnd7yV50BTDGvOx6FKgEr/T9OSPMZQ=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:19.065282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-5c4a016f-3e8b-49ca-b49d-68441bb52f70 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for project 886baa7c44f641d287f911a81bebaa13. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:19.069202 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-5c4a016f-3e8b-49ca-b49d-68441bb52f70 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for user 89de93e6f9564e2cb73500e3d383e836 and project 886baa7c44f641d287f911a81bebaa13. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:19.204766 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5c4a016f-3e8b-49ca-b49d-68441bb52f70 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159887 Aug 02 10:59:19.205484 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1275/3132] 10.222.0.49 () {60 vars in 1159 bytes} [Tue Aug 2 10:59:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:21.630083 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1944461588", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d860e69-11b5-4728-87bc-53cf179a69f3"}], "security_groups": [{"name": "tempest-securitygroup--1772662663"}], "key_name": "tempest-keypair-1060728753", "user_data": "}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:21.738468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] validate_networks() for [('9d860e69-11b5-4728-87bc-53cf179a69f3', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:59:22.129747 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:59:22.130170 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:59:22.130673 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:59:22.131256 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:59:22.131678 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:59:22.140561 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:22.141008 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:22.141840 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:22.142276 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:22.159211 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for project 886baa7c44f641d287f911a81bebaa13. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:22.163065 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Getting quotas for user 89de93e6f9564e2cb73500e3d383e836 and project 886baa7c44f641d287f911a81bebaa13. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:22.178752 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:59:22.181059 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:59:22.326854 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0cefbe4e-f4e9-457e-8d9f-8680586d83fd tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701878 Aug 02 10:59:22.327538 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1858/3133] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 10:59:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:59:22.338764 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bb8611c4-306e-4058-804f-e9a5c51361b1 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:22.339440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bb8611c4-306e-4058-804f-e9a5c51361b1 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:22.411803 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bb8611c4-306e-4058-804f-e9a5c51361b1 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:22.419571 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bb8611c4-306e-4058-804f-e9a5c51361b1 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1238 microversion: 2.1 time: 0.084949 Aug 02 10:59:22.420148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1276/3134] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:22 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:23.441297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:23.441955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:23.449877 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:23.450803 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:23.451341 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:23.451614 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:23.514619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:23.522688 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d6feea3b-ad82-4167-887f-311f10b5be85 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1242 microversion: 2.1 time: 0.085784 Aug 02 10:59:23.523302 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1859/3135] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:23 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:24.543899 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:24.544519 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:24.550868 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:24.551361 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:24.552157 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:24.552587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:24.613978 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:24.622472 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0324ede6-b862-4699-8501-fbf2bbc45b5d tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1298 microversion: 2.1 time: 0.082424 Aug 02 10:59:24.623047 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1277/3136] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:24 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:25.643879 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:25.644502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:25.651264 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:25.651637 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:25.652455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:25.652986 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:25.913974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:25.922532 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8d0d2948-f926-4cb5-8d7d-715cf385a2fe tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.282535 Aug 02 10:59:25.923621 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1860/3137] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:25 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:26.431125 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-16834c0c-5776-4b89-a12a-36ada919f23f req-cb2491f3-243a-4682-8624-e7dea4cb9f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bb6a8d-1b90-45e7-ae35-5815f31fc198", "tag": "199edbe6-c2e3-4018-b7fb-b5b7c87d17bf"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:26.441847 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-16834c0c-5776-4b89-a12a-36ada919f23f req-cb2491f3-243a-4682-8624-e7dea4cb9f8f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:26.442288 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-16834c0c-5776-4b89-a12a-36ada919f23f req-cb2491f3-243a-4682-8624-e7dea4cb9f8f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:26.454953 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-16834c0c-5776-4b89-a12a-36ada919f23f req-cb2491f3-243a-4682-8624-e7dea4cb9f8f service nova] Creating event network-changed:199edbe6-c2e3-4018-b7fb-b5b7c87d17bf for instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 on hv-cinder-84753 Aug 02 10:59:26.460710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-16834c0c-5776-4b89-a12a-36ada919f23f req-cb2491f3-243a-4682-8624-e7dea4cb9f8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033639 Aug 02 10:59:26.461522 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1278/3138] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:26.948018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:26.948018 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:26.952635 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:26.953129 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:26.954020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:26.954456 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:27.155123 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:27.162909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e265e072-7c68-4a71-bc93-e585dbf8f772 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.222403 Aug 02 10:59:27.163512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1861/3139] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:26 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:28.186645 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:28.187365 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:28.194049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:28.194509 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:28.195287 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:28.195724 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:28.331256 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:28.338922 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8c2e807e-304e-4bae-9282-9ab20b6531e4 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.157133 Aug 02 10:59:28.339653 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1279/3140] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:28 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:29.360671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:29.361235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:29.367741 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:29.368188 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:29.369438 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:29.369872 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:29.498314 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:29.506248 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-093a0f0e-f7e4-4a15-88c7-6392c4ade15f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.149488 Aug 02 10:59:29.506821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1862/3141] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:29 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:30.527844 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:30.529455 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:30.536469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:30.542420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:30.542420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:30.542420 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:30.686010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:30.698946 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-65031d16-cea6-486e-b322-4a1b7360ed4b tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.175612 Aug 02 10:59:30.699780 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1280/3142] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:30 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:31.723100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:31.723913 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:31.730702 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:31.731149 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:31.731944 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:31.732502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:31.864242 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:31.872469 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3337d696-1c8a-4b61-9ae9-dcf3c1e8789a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.153206 Aug 02 10:59:31.873043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1863/3143] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:31 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:32.480693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-115ae0dc-bdac-458c-bdf4-6d0deef66efc req-08847df9-db99-4672-b9f8-88a486a58941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb6a8d-1b90-45e7-ae35-5815f31fc198", "name": "network-vif-plugged", "status": "completed", "tag": "199edbe6-c2e3-4018-b7fb-b5b7c87d17bf"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:32.487096 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:32.491434 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-115ae0dc-bdac-458c-bdf4-6d0deef66efc req-08847df9-db99-4672-b9f8-88a486a58941 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:32.491870 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-115ae0dc-bdac-458c-bdf4-6d0deef66efc req-08847df9-db99-4672-b9f8-88a486a58941 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:32.503579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-115ae0dc-bdac-458c-bdf4-6d0deef66efc req-08847df9-db99-4672-b9f8-88a486a58941 service nova] Creating event network-vif-plugged:199edbe6-c2e3-4018-b7fb-b5b7c87d17bf for instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 on hv-cinder-84753 Aug 02 10:59:32.508610 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-115ae0dc-bdac-458c-bdf4-6d0deef66efc req-08847df9-db99-4672-b9f8-88a486a58941 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 02 10:59:32.514444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1281/3144] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:32.894640 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:32.895327 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:32.897415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:32.904177 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=6 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:32.904955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:32.905443 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:32.906288 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:32.906757 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:33.051315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:33.059298 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-468af36e-e30c-48f0-bdfc-ee8c3b1cacaa tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.169425 Aug 02 10:59:33.059884 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1864/3145] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:32 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:34.081273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:34.087542 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:34.088665 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:34.089103 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:34.089853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:34.090281 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:34.219800 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:34.227544 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4934844b-fd5e-421b-b985-92bb4607c643 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1364 microversion: 2.1 time: 0.150782 Aug 02 10:59:34.228648 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1282/3146] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:34 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:35.249825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:35.250835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:35.257592 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:35.258043 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:35.258817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:35.259277 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:35.395787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:35.403619 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3fde9331-2095-41cd-ac4c-cfb7697ccbea tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1549 microversion: 2.1 time: 0.158107 Aug 02 10:59:35.404192 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1865/3147] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 10:59:35 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:35.424829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:35.425438 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:35.432799 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:35.433240 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:35.434012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:35.434440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:35.522355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-98460dd2-e604-4675-92f2-ca972c2a30b8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096679 Aug 02 10:59:35.522355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1283/3148] 10.222.0.49 () {58 vars in 1275 bytes} [Tue Aug 2 10:59:35 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:36.862498 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-336d59ed-02e9-4c61-96d7-9256956c90ff req-f8fec0c7-b438-4e0a-8d3c-12a345b69f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bb6a8d-1b90-45e7-ae35-5815f31fc198", "tag": "199edbe6-c2e3-4018-b7fb-b5b7c87d17bf"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:36.872104 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-336d59ed-02e9-4c61-96d7-9256956c90ff req-f8fec0c7-b438-4e0a-8d3c-12a345b69f33 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:36.872545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-336d59ed-02e9-4c61-96d7-9256956c90ff req-f8fec0c7-b438-4e0a-8d3c-12a345b69f33 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:36.883920 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-336d59ed-02e9-4c61-96d7-9256956c90ff req-f8fec0c7-b438-4e0a-8d3c-12a345b69f33 service nova] Creating event network-changed:199edbe6-c2e3-4018-b7fb-b5b7c87d17bf for instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 on hv-cinder-84753 Aug 02 10:59:36.889038 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-336d59ed-02e9-4c61-96d7-9256956c90ff req-f8fec0c7-b438-4e0a-8d3c-12a345b69f33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126274 Aug 02 10:59:36.889643 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1866/3149] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 10:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:42.920384 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:59:42.920997 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 10:59:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:00:13.006001 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:13.006777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:13.010911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:13.011442 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:13.018440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.018940 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.022668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.023111 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.049971 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6480707f-e668-46d8-969b-6b720d097a3c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/ips" status: 200 len: 145 microversion: 2.1 time: 0.045299 Aug 02 11:00:13.050541 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1284/3150] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 11:00:13 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:14.745261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:14.745992 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=72 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:14.750835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dff9dfb-97da-400f-ad4a-0b282e55108b"}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:14.756697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:14.760200 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.760656 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.761441 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.761878 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.774099 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eb32ea13-2477-4d03-8cc1-dfb2a4c42489 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030328 Aug 02 11:00:15.774873 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1867/3151] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 11:00:14 2022] POST /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:23.362267 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:23.364468 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:23.372994 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.373469 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.374264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.374742 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.431970 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-67f83db6-1c39-4614-be64-0a502164ce58 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073600 Aug 02 11:00:23.432947 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1285/3152] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 11:00:23 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:23.449266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:23.449897 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:23.459631 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.460395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.461451 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.461989 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.503252 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-34f6d07e-030e-4b48-9dbd-ac64240056c2 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b" status: 200 len: 194 microversion: 2.1 time: 0.059203 Aug 02 11:00:23.503887 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1868/3153] 10.222.0.49 () {58 vars in 1413 bytes} [Tue Aug 2 11:00:23 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:25.285529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "785c05b6-a108-4d72-8e5f-ffad745da63a"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:25.287943 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:25.294529 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.294975 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.295806 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.296242 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:26.317931 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c013dff3-fa5b-498f-878e-23c739a9de04 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "POST /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037106 Aug 02 11:00:26.318641 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1286/3154] 10.222.0.49 () {60 vars in 1323 bytes} [Tue Aug 2 11:00:25 2022] POST /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 194 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:34.916051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:34.918197 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:34.920893 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=4 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:34.921562 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:34.926571 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:34.931033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.931033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:34.931033 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.960501 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-bb40d501-e8a1-4e01-ab6e-8f7d9c700540 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048270 Aug 02 11:00:34.961078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1869/3155] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 11:00:34 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:35.141049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:35.141638 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:35.148651 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.149104 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.149867 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.150302 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.179906 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f42db78e-d0bf-4509-bcb3-ad5c072a5533 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b" status: 200 len: 194 microversion: 2.1 time: 0.043973 Aug 02 11:00:35.180497 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1287/3156] 10.222.0.49 () {58 vars in 1413 bytes} [Tue Aug 2 11:00:35 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:35.192116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:35.192607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:35.199324 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.199774 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.200570 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.201006 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.285926 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lazy-loading 'services' on Instance uuid 03bb6a8d-1b90-45e7-ae35-5815f31fc198 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:00:35.532439 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9df10594-f886-4010-ac80-9d568276d057 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b" status: 202 len: 0 microversion: 2.1 time: 0.344248 Aug 02 11:00:35.536348 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1870/3157] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 11:00:35 2022] DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/8dff9dfb-97da-400f-ad4a-0b282e55108b => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:37.722478 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:37.723028 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:37.730490 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.730974 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.731839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.732276 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.762595 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b0c55837-ff15-4822-a150-a456dcbe831f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/785c05b6-a108-4d72-8e5f-ffad745da63a" status: 200 len: 194 microversion: 2.1 time: 0.043997 Aug 02 11:00:37.763224 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1288/3158] 10.222.0.49 () {58 vars in 1413 bytes} [Tue Aug 2 11:00:37 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/785c05b6-a108-4d72-8e5f-ffad745da63a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:37.774253 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:37.775072 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:37.782210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.782802 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.783467 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.783906 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.868172 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lazy-loading 'services' on Instance uuid 03bb6a8d-1b90-45e7-ae35-5815f31fc198 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:00:38.089751 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5774b110-aec2-4774-9fe8-a3a54479bb8c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/785c05b6-a108-4d72-8e5f-ffad745da63a" status: 202 len: 0 microversion: 2.1 time: 0.319512 Aug 02 11:00:38.090259 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1871/3159] 10.222.0.49 () {58 vars in 1416 bytes} [Tue Aug 2 11:00:37 2022] DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments/785c05b6-a108-4d72-8e5f-ffad745da63a => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:38.662454 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:38.662927 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:38.671357 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.678042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.678042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.678042 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.697902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] HTTP exception thrown: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Request method failure captured: Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f HTTP/1.1 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqfiPRwe5uxvefyh2hB9FhcjyT8YGnIdmIbO3hlhbHQFTpbGDoUSUuI2TLCml73ORmj6LfjQRPTwd5k74bX_E6v_eeBCGd9V7TCVTe09JDA2NwrcjUAfdRpRL5vU9vqVKlTsYBdM88ChkyZSVWrCbpw9yJO1QXC1r_7jb792Y2bRm0 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:38.700698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/662f508ce05e4a85896f30f772be6410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_662f508ce05e4a85896f30f772be6410", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: f6880f2f7ad749beb68cd6445f3cc6d6 Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.703049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '694dcbbc-916c-4b2a-b571-9225b4c1127f'} Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:38.704858 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.708590 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.711849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Returning 404 to user: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:38.711849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5feee892-daca-486f-9b65-a7f22dd7303c tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 404 len: 111 microversion: 2.20 time: 0.044175 Aug 02 11:00:38.711849 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1289/3160] 10.222.0.49 () {60 vars in 1280 bytes} [Tue Aug 2 11:00:38 2022] DELETE /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 11:00:38.715821 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:38.719904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] [instance: 694dcbbc-916c-4b2a-b571-9225b4c1127f] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:38.723127 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.723607 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.724373 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.724810 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.738077 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] HTTP exception thrown: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Request method failure captured: Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f HTTP/1.1 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqfiPRwe5uxvefyh2hB9FhcjyT8YGnIdmIbO3hlhbHQFTpbGDoUSUuI2TLCml73ORmj6LfjQRPTwd5k74bX_E6v_eeBCGd9V7TCVTe09JDA2NwrcjUAfdRpRL5vU9vqVKlTsYBdM88ChkyZSVWrCbpw9yJO1QXC1r_7jb792Y2bRm0 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:38.739859 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/662f508ce05e4a85896f30f772be6410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/662f508ce05e4a85896f30f772be6410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_662f508ce05e4a85896f30f772be6410", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 662f508ce05e4a85896f30f772be6410 Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-520690928 Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: f6880f2f7ad749beb68cd6445f3cc6d6 Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-520690928-project Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.741856 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '694dcbbc-916c-4b2a-b571-9225b4c1127f'} Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:38.743045 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. Aug 02 11:00:38.744800 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:38.746312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] Returning 404 to user: Instance 694dcbbc-916c-4b2a-b571-9225b4c1127f could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:38.746312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-15ed9dc0-c681-407e-a52b-66b48332e8ea tempest-AttachVolumeShelveTestJSON-520690928 tempest-AttachVolumeShelveTestJSON-520690928-project] 10.222.0.49 "GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f" status: 404 len: 111 microversion: 2.20 time: 0.030693 Aug 02 11:00:38.746312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1872/3161] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Aug 2 11:00:38 2022] GET /compute/v2.1/servers/694dcbbc-916c-4b2a-b571-9225b4c1127f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:00:39.275085 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:39.283987 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:39.285873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.286573 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.287456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.287910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.322579 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d45f7096-42d7-4c81-8d58-a64d47f485c0 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051537 Aug 02 11:00:39.323164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1290/3162] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 11:00:39 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 11:00:39.465980 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:39.468520 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:39.475685 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.476328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.477297 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.477787 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.511841 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-94b41cc0-471d-418b-a554-9a25157ee24a tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049879 Aug 02 11:00:39.512780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1873/3163] 10.222.0.49 () {58 vars in 1302 bytes} [Tue Aug 2 11:00:39 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:00:39.586412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:39.586913 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:39.593386 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.593884 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.594676 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.595109 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.621264 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:00:39.967698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fabdad33-b9b2-460c-902f-4492826261d6 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 204 len: 0 microversion: 2.1 time: 0.380239 Aug 02 11:00:39.967698 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1291/3164] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:00:39 2022] DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:00:39.973052 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:39.973995 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:39.981058 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.981783 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.982739 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.983385 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.222315 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:40.230961 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-4c8f969d-cb0c-4f55-910c-d2d2c866688e tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1674 microversion: 2.1 time: 0.261784 Aug 02 11:00:40.231974 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1874/3165] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:39 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:41.253145 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:41.253893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:41.261304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:41.261693 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:41.262467 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:41.262914 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:41.399587 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:41.407513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fda74474-fd57-4375-babd-2762a6391ac9 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1674 microversion: 2.1 time: 0.158239 Aug 02 11:00:41.408120 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1292/3166] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:41 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:42.430905 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:42.431866 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:42.439158 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.440057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.440902 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.441445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.997274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:43.004732 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9447afde-3938-48b9-84c4-b9e76f432b49 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1674 microversion: 2.1 time: 0.578808 Aug 02 11:00:43.005296 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1875/3167] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:42 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1674 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:43.617647 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-a35e0229-ac70-4357-bca2-2f412dcbc850 req-d481a1c1-7fb8-4ccd-ad43-16e36598332d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bb6a8d-1b90-45e7-ae35-5815f31fc198", "name": "network-vif-deleted", "tag": "199edbe6-c2e3-4018-b7fb-b5b7c87d17bf"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:43.627311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-a35e0229-ac70-4357-bca2-2f412dcbc850 req-d481a1c1-7fb8-4ccd-ad43-16e36598332d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:43.627768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-a35e0229-ac70-4357-bca2-2f412dcbc850 req-d481a1c1-7fb8-4ccd-ad43-16e36598332d service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:43.640050 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-a35e0229-ac70-4357-bca2-2f412dcbc850 req-d481a1c1-7fb8-4ccd-ad43-16e36598332d service nova] Creating event network-vif-deleted:199edbe6-c2e3-4018-b7fb-b5b7c87d17bf for instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 on hv-cinder-84753 Aug 02 11:00:43.645441 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-a35e0229-ac70-4357-bca2-2f412dcbc850 req-d481a1c1-7fb8-4ccd-ad43-16e36598332d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Aug 02 11:00:43.646265 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1293/3168] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:44.026564 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:44.027209 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:44.036364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.036364 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.037035 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.037599 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.075665 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.076255 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.076789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lazy-loading 'fault' on Instance uuid 03bb6a8d-1b90-45e7-ae35-5815f31fc198 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:00:44.119013 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89de93e6f9564e2cb73500e3d383e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886baa7c44f641d287f911a81bebaa13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:44.128420 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-a6c1187c-345a-4e20-8bb4-21743590d13f tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 200 len: 1328 microversion: 2.1 time: 0.105703 Aug 02 11:00:44.138157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1876/3169] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:44 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:45.151755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.152377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:45.159023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:45.159498 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:45.160589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:45.161020 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:45.174418 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 HTTP/1.1 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:45.176751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:45.178710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '03bb6a8d-1b90-45e7-ae35-5815f31fc198'} Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.179834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:45.182504 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.185282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.185282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-712184e9-4c64-48eb-933c-fa0a84f76553 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 404 len: 111 microversion: 2.1 time: 0.031678 Aug 02 11:00:45.185282 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1294/3170] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:45 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:45.187515 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-94966bd4-20b4-4ba5-9936-75293648658c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '.version_select at 0x7f70c2b17670>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.304553 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-94966bd4-20b4-4ba5-9936-75293648658c tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060728753" status: 202 len: 0 microversion: 2.1 time: 0.121037 Aug 02 11:00:45.305353 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1877/3171] 10.222.0.49 () {58 vars in 1221 bytes} [Tue Aug 2 11:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060728753 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:45.316512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ccfd7c9e-3124-4948-9bc9-96f3d0a8742c tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Action: 'create', calling method: .version_select at 0x7f70cb465dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-838143236", "metadata": {"Type": "work"}}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ccfd7c9e-3124-4948-9bc9-96f3d0a8742c tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 121 Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:45.333183 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-838143236", "metadata": {"Type": "work"}}} Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 11:00:45.335167 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-838143236', 'metadata': {'Type': 'work'}}}} Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise error Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.336538 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 11:00:45.338450 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 11:00:45.340391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 11:00:45.340391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.340391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ccfd7c9e-3124-4948-9bc9-96f3d0a8742c tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.340391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ccfd7c9e-3124-4948-9bc9-96f3d0a8742c tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146395 Aug 02 11:00:45.340391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1295/3172] 10.222.0.49 () {60 vars in 1156 bytes} [Tue Aug 2 11:00:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:00:45.345433 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5098897b-9f9b-4b83-9fef-10d13c755cf1 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Action: 'create', calling method: .version_select at 0x7f70c3419550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1141913381", "metadata": {"Type": "work"}}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5098897b-9f9b-4b83-9fef-10d13c755cf1 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 120 Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:45.350039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1141913381", "metadata": {"Type": "work"}}} Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: Aug 02 11:00:45.351947 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1141913381', 'metadata': {'Type': 'work'}}}} Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise error Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi '0' Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.353471 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 11:00:45.355323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 11:00:45.364990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 11:00:45.364990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.364990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5098897b-9f9b-4b83-9fef-10d13c755cf1 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.364990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5098897b-9f9b-4b83-9fef-10d13c755cf1 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010559 Aug 02 11:00:45.364990 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1878/3173] 10.222.0.49 () {60 vars in 1156 bytes} [Tue Aug 2 11:00:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:00:45.365456 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc8b934c-eec1-45c6-92d8-a1eb65d0ef0d tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Action: 'create', calling method: .version_select at 0x7f70cb446f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-822600300", "metadata": {"Type": "work"}}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc8b934c-eec1-45c6-92d8-a1eb65d0ef0d tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 118 Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:45.367072 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-822600300", "metadata": {"Type": "work"}}} Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 11:00:45.368930 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-822600300', 'metadata': {'Type': 'work'}}}} Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise error Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi '' Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.370211 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 11:00:45.372021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 11:00:45.373523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 11:00:45.373523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.373523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc8b934c-eec1-45c6-92d8-a1eb65d0ef0d tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.373523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc8b934c-eec1-45c6-92d8-a1eb65d0ef0d tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010993 Aug 02 11:00:45.373523 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1296/3174] 10.222.0.49 () {60 vars in 1156 bytes} [Tue Aug 2 11:00:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:00:45.380697 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ce41b1d-a0c5-4e15-a5a2-435cf16f885f tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Calling method '.version_select at 0x7f70c3656b80>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.408672 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-2ce41b1d-a0c5-4e15-a5a2-435cf16f885f tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] HTTP exception thrown: Volume tempest-invalid-22376355 could not be found. Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ce41b1d-a0c5-4e15-a5a2-435cf16f885f tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-22376355 HTTP/1.1 Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:45.411326 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Volume tempest-invalid-22376355 could not be found. Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'tempest-invalid-22376355'} Aug 02 11:00:45.413472 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-22376355 could not be found. (HTTP 404) (Request-ID: req-0acefd75-3a61-459b-b510-24d34f63a190) Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.414743 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:00:45.416987 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-22376355 could not be found. Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:45.418882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-22376355 could not be found. Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-22376355 could not be found. Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-2ce41b1d-a0c5-4e15-a5a2-435cf16f885f tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 404 to user: Volume tempest-invalid-22376355 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-2ce41b1d-a0c5-4e15-a5a2-435cf16f885f tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-22376355" status: 404 len: 97 microversion: 2.1 time: 0.038527 Aug 02 11:00:45.420797 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1879/3175] 10.222.0.49 () {58 vars in 1212 bytes} [Tue Aug 2 11:00:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-22376355 => generated 97 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 11:00:45.424012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-17aa5928-bfc9-4be3-87fc-5f12fbf0f58d tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004343 Aug 02 11:00:45.426747 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1297/3176] 10.222.0.49 () {58 vars in 1140 bytes} [Tue Aug 2 11:00:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 11:00:45.434391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-c8cb43b6-9d42-4df4-8a46-169a68a4d628 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003795 Aug 02 11:00:45.435053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1880/3177] 10.222.0.49 () {58 vars in 1137 bytes} [Tue Aug 2 11:00:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 11:00:45.445925 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e1216dff-e9e6-4a56-9d42-fab1abfae241 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Calling method '.version_select at 0x7f70cb4653a0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.474668 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-e1216dff-e9e6-4a56-9d42-fab1abfae241 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] HTTP exception thrown: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e1216dff-e9e6-4a56-9d42-fab1abfae241 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/os-volumes/17f55d52-c57e-42f9-9275-2e41925069e1 HTTP/1.1 Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:45.476770 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '17f55d52-c57e-42f9-9275-2e41925069e1'} Aug 02 11:00:45.478584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. (HTTP 404) (Request-ID: req-3f90a1be-0a2d-4fd4-9228-bda3e2d286f0) Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.480311 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:00:45.481790 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 11:00:45.483340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e1216dff-e9e6-4a56-9d42-fab1abfae241 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 404 to user: Volume 17f55d52-c57e-42f9-9275-2e41925069e1 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e1216dff-e9e6-4a56-9d42-fab1abfae241 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/17f55d52-c57e-42f9-9275-2e41925069e1" status: 404 len: 109 microversion: 2.1 time: 0.036136 Aug 02 11:00:45.484910 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1298/3178] 10.222.0.49 () {58 vars in 1248 bytes} [Tue Aug 2 11:00:45 2022] DELETE /compute/v2.1/os-volumes/17f55d52-c57e-42f9-9275-2e41925069e1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:45.488056 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90624320-fce6-40e6-8167-271e9041a1a2 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Calling method '.version_select at 0x7f70cb4719d0>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.516994 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-90624320-fce6-40e6-8167-271e9041a1a2 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] HTTP exception thrown: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90624320-fce6-40e6-8167-271e9041a1a2 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Request method failure captured: Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/os-volumes/af92288a-a04c-4f94-9383-5339d162a8bc HTTP/1.1 Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QPd1Hs47R2r4C0plV1ZAhO7QwjappHfLF2O44Nm_3tVFhqU-qYVfy6goRU-R3sVPJXDhtG45gYSVI7M7TL9yXtjjo7-YzhBkEjtjOh8hOsvQ5nEC22BHz-dETvbCbmQwlmcSXsHi2y6O6HmzVK0EY2e97uoiPPeY3eKQbRZ8CPgOvA Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:45.519053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b5d842ccfca402e824fc4bce7b8d85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b5d842ccfca402e824fc4bce7b8d85b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 9b5d842ccfca402e824fc4bce7b8d85b Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesNegativeTest-1788040827 Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: bcafe82d93c64891a4eff34c3fcefad7 Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesNegativeTest-1788040827-project Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'af92288a-a04c-4f94-9383-5339d162a8bc'} Aug 02 11:00:45.521509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. (HTTP 404) (Request-ID: req-c4636d4b-8a96-4719-97da-ec74de8b7447) Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.522589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:00:45.526312 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 11:00:45.532823 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-90624320-fce6-40e6-8167-271e9041a1a2 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] Returning 404 to user: Volume af92288a-a04c-4f94-9383-5339d162a8bc could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-90624320-fce6-40e6-8167-271e9041a1a2 tempest-VolumesNegativeTest-1788040827 tempest-VolumesNegativeTest-1788040827-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/af92288a-a04c-4f94-9383-5339d162a8bc" status: 404 len: 109 microversion: 2.1 time: 0.036896 Aug 02 11:00:45.534901 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1881/3179] 10.222.0.49 () {58 vars in 1245 bytes} [Tue Aug 2 11:00:45 2022] GET /compute/v2.1/os-volumes/af92288a-a04c-4f94-9383-5339d162a8bc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:48.876600 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:48.877130 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:48.883147 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.883643 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.884407 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.884843 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.898270 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 HTTP/1.1 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:48.899854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.901606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '03bb6a8d-1b90-45e7-ae35-5815f31fc198'} Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:48.902615 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.904310 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.906026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:48.906026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2a491eaa-7707-4282-865a-6541340876b3 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 404 len: 111 microversion: 2.1 time: 0.029744 Aug 02 11:00:48.906026 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1299/3180] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:00:48 2022] DELETE /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:48.919710 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:48.920322 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: 03bb6a8d-1b90-45e7-ae35-5815f31fc198] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:48.926491 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.926941 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.927755 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.928229 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.941658 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 HTTP/1.1 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:48.943111 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.945003 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '03bb6a8d-1b90-45e7-ae35-5815f31fc198'} Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:48.946023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. Aug 02 11:00:48.947695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:48.949246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance 03bb6a8d-1b90-45e7-ae35-5815f31fc198 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:48.949246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-e853d34e-053f-450a-97b2-a570da583974 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198" status: 404 len: 111 microversion: 2.1 time: 0.029546 Aug 02 11:00:48.949246 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1882/3181] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:48 2022] GET /compute/v2.1/servers/03bb6a8d-1b90-45e7-ae35-5815f31fc198 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:50.270500 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:50.271007 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:50.277861 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.278331 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.279148 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.279613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.294942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a HTTP/1.1 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:00:50.296540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.298369 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'bc81574c-6e3f-48bc-b74b-bf5097dd340a'} Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:50.299499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.300977 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.302660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:50.302660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25d8f1e4-85f6-4dc1-a412-607898c1a695 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 404 len: 111 microversion: 2.1 time: 0.031849 Aug 02 11:00:50.302660 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1300/3182] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:00:50 2022] DELETE /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:50.306416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:50.313512 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] [instance: bc81574c-6e3f-48bc-b74b-bf5097dd340a] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:50.313690 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.314115 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.314880 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.315365 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.329670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] HTTP exception thrown: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Request method failure captured: Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a HTTP/1.1 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QLcmdplTqDeYJOqC3RFHTmLoceT8Bm00QcDBd7ZZzg1ThcoKYv7r6CgKCljY8Q5WmDqbx7VUkgZLJyMcDb2JgaO3Mo8xlgkO3uvzaDCTX7hoGO6MHbgvjeVPkzgJDsEKStXUW1Z-fT140CzhgRp9936UjpO6MK_w6xHAgJiEOl5fDw Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:00:50.331240 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/886baa7c44f641d287f911a81bebaa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_886baa7c44f641d287f911a81bebaa13", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 886baa7c44f641d287f911a81bebaa13 Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2012235664 Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: 89de93e6f9564e2cb73500e3d383e836 Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeTestJSON-2012235664-project Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.333652 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'bc81574c-6e3f-48bc-b74b-bf5097dd340a'} Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:50.334734 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. Aug 02 11:00:50.336178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:00:50.337689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] Returning 404 to user: Instance bc81574c-6e3f-48bc-b74b-bf5097dd340a could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:50.337689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-996999e0-f242-4987-8feb-f7b484fee1c8 tempest-AttachVolumeTestJSON-2012235664 tempest-AttachVolumeTestJSON-2012235664-project] 10.222.0.49 "GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a" status: 404 len: 111 microversion: 2.1 time: 0.030602 Aug 02 11:00:50.337689 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1883/3183] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:00:50 2022] GET /compute/v2.1/servers/bc81574c-6e3f-48bc-b74b-bf5097dd340a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:02:33.485008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:33.485864 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:33.490810 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:33.491340 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:33.497607 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:33.498044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:33.498888 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:33.499353 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:33.516087 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 HTTP/1.1 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:02:33.517650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.520346 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8'} Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:02:33.521839 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.524460 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.526893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:02:33.526893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-16e3393b-2b82-4edd-ad5f-9ba271eae905 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 404 len: 111 microversion: 2.1 time: 0.036207 Aug 02 11:02:33.526893 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1301/3184] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:02:33 2022] DELETE /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:02:33.531953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:33.531953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:33.531953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:33.531953 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] [instance: fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:33.538681 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:33.539007 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:33.539843 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:33.540279 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:33.555545 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] HTTP exception thrown: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Request method failure captured: Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 HTTP/1.1 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6PqbYWpuWIGJsVvTnhrrEM86ltXBq9O6dR46RJvQbWii2c7HxrUCQEJP8l936xZAy5iTqKClmkSZVSaiz5kq3Ftwq4j8d0Jx4bvm_lmk1ac3te2SNIqBCaaJ6w6yfNaRxKJYYs2fTFUhyJIkxVDoBuQvvER5PXfIZmNUpQFWl67oojk Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:02:33.557094 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0dc1c45a26e84a3bbc06d52fec42e332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0dc1c45a26e84a3bbc06d52fec42e332", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 0dc1c45a26e84a3bbc06d52fec42e332 Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1697891159 Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: d2ee2b6dd6f647179d2af999b3e62788 Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-AttachVolumeNegativeTest-1697891159-project Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.559608 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': 'fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8'} Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:02:33.561226 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. Aug 02 11:02:33.566867 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:02:33.568459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] Returning 404 to user: Instance fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:02:33.568459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-eff9f7ba-15a9-430f-ae3c-31d33067c916 tempest-AttachVolumeNegativeTest-1697891159 tempest-AttachVolumeNegativeTest-1697891159-project] 10.222.0.49 "GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8" status: 404 len: 111 microversion: 2.1 time: 0.034614 Aug 02 11:02:33.568459 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1884/3185] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:02:33 2022] GET /compute/v2.1/servers/fa6d96cb-2995-41e4-9f4d-f3d3d501f6a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:03:02.928723 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:03:02.929273 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:03:51.511829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0526965-7adb-455f-9cfa-8d1156cce1dc] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 11:03:51.518192 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1491008047", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "networks": [{"uuid": "ebb84e3e-801f-4759-85d3-444c87d1e750"}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:51.766159 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] validate_networks() for [('ebb84e3e-801f-4759-85d3-444c87d1e750', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:03:52.440834 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:03:52.441258 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:03:52.441730 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:03:52.442142 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:03:52.442554 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:03:52.452335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.452782 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.453576 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.454008 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.471976 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Getting quotas for project 5c7f14f32755499680d0678f349ad2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:03:52.476067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Getting quotas for user fcf55ad0572e4f7492ab7d73fa0cdce7 and project 5c7f14f32755499680d0678f349ad2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:03:52.487049 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:03:52.489387 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:03:52.525417 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0526965-7adb-455f-9cfa-8d1156cce1dc] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47794. Aug 02 11:03:52.657873 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8c80259d-750d-4c07-b13a-c1121f93a7df tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148133 Aug 02 11:03:52.658510 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1302/3186] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 11:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 11:03:52.667976 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82aadd10-2000-453e-bc66-b37b15623c80] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 11:03:52.672825 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-1724fc3b-b881-449f-90cc-6d714f8fbee6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:52.673434 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-1724fc3b-b881-449f-90cc-6d714f8fbee6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:52.784266 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-1724fc3b-b881-449f-90cc-6d714f8fbee6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:52.791572 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-1724fc3b-b881-449f-90cc-6d714f8fbee6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1214 microversion: 2.1 time: 0.125866 Aug 02 11:03:52.792144 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1885/3187] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:52 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:53.814067 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-636ab84d-2ac6-4479-bfc7-efa894c28890 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:53.814681 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-636ab84d-2ac6-4479-bfc7-efa894c28890 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:53.871606 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-636ab84d-2ac6-4479-bfc7-efa894c28890 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:53.879164 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-636ab84d-2ac6-4479-bfc7-efa894c28890 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1214 microversion: 2.1 time: 0.070167 Aug 02 11:03:53.879689 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1303/3188] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:53 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:54.900193 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:54.900748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:54.909955 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:54.910400 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:54.911159 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:54.911623 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:54.930857 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] [82aadd10-2000-453e-bc66-b37b15623c80] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47816. Aug 02 11:03:54.976882 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:54.985086 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-5faca708-b63c-4bb7-98a9-135d00c45d00 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1266 microversion: 2.1 time: 0.088846 Aug 02 11:03:54.985667 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1886/3189] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:54 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:56.006751 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:56.007506 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:56.014272 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:56.014777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:56.015567 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:56.016006 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:56.147520 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:56.155919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c027ea05-6f15-40e1-b3c7-194e1c13a9d4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.153119 Aug 02 11:03:56.156499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1304/3190] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:56 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:56.847468 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-4187a78b-4e48-4d06-98cf-38e4d7022788 req-20316dfe-a0a2-476c-9309-bc5171e1f4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1d763e-c57b-4375-936c-bb472031b743", "tag": "132cc723-3e17-4787-b484-9350f95fd52f"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:56.856946 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-4187a78b-4e48-4d06-98cf-38e4d7022788 req-20316dfe-a0a2-476c-9309-bc5171e1f4b6 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:56.857937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-4187a78b-4e48-4d06-98cf-38e4d7022788 req-20316dfe-a0a2-476c-9309-bc5171e1f4b6 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:56.868881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-4187a78b-4e48-4d06-98cf-38e4d7022788 req-20316dfe-a0a2-476c-9309-bc5171e1f4b6 service nova] Creating event network-changed:132cc723-3e17-4787-b484-9350f95fd52f for instance 4f1d763e-c57b-4375-936c-bb472031b743 on hv-cinder-84753 Aug 02 11:03:56.874342 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-4187a78b-4e48-4d06-98cf-38e4d7022788 req-20316dfe-a0a2-476c-9309-bc5171e1f4b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097863 Aug 02 11:03:56.874914 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1887/3191] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:57.177474 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:57.178088 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:57.185412 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:57.185878 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:57.186635 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:57.187065 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:57.323623 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:57.331307 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-df5e5056-f025-49f0-875d-0140bae9664a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.157618 Aug 02 11:03:57.332037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1305/3192] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:57 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:58.352798 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:58.353529 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:58.360838 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:58.361321 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:58.362116 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:58.362551 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:58.495670 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:58.504063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-278a23e9-7868-4899-a423-fe87e7743b64 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.155916 Aug 02 11:03:58.504706 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1888/3193] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:58 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:59.524091 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:59.524706 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:59.531777 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:59.532222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:59.533572 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:59.534314 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:59.665584 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:59.673786 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7343bb28-7061-4192-ac00-895399b20747 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.153485 Aug 02 11:03:59.674358 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1306/3194] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:03:59 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:00.695409 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:00.696295 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:00.702828 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:00.703415 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:00.704178 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:00.704604 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:00.836337 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:00.843726 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-80fbb391-1f59-4312-a6aa-083cc0983b7e tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.152124 Aug 02 11:04:00.844283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1889/3195] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:00 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:01.864306 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:01.864924 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:01.871612 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:01.872044 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:01.873107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:01.873528 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:01.930548 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-21511b72-78fd-463c-a1b4-bfb7ede71a47 req-289883af-ee79-447c-bc16-e737a8520113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1d763e-c57b-4375-936c-bb472031b743", "name": "network-vif-plugged", "status": "completed", "tag": "132cc723-3e17-4787-b484-9350f95fd52f"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:01.940655 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-21511b72-78fd-463c-a1b4-bfb7ede71a47 req-289883af-ee79-447c-bc16-e737a8520113 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:01.941103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-21511b72-78fd-463c-a1b4-bfb7ede71a47 req-289883af-ee79-447c-bc16-e737a8520113 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:01.954745 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-21511b72-78fd-463c-a1b4-bfb7ede71a47 req-289883af-ee79-447c-bc16-e737a8520113 service nova] Creating event network-vif-plugged:132cc723-3e17-4787-b484-9350f95fd52f for instance 4f1d763e-c57b-4375-936c-bb472031b743 on hv-cinder-84753 Aug 02 11:04:01.960047 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-21511b72-78fd-463c-a1b4-bfb7ede71a47 req-289883af-ee79-447c-bc16-e737a8520113 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093789 Aug 02 11:04:01.960835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1890/3196] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:04:02.012577 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:02.020239 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dccd5c8d-453c-4a40-8f70-51ed44fbca6b tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.159763 Aug 02 11:04:02.021010 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1307/3197] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:01 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:03.038662 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:03.043598 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:03.044300 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:03.050419 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:03.051114 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:03.051641 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:03.052078 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:03.185465 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:03.193568 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-9232a37d-191e-4090-a852-c6168e976c88 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1314 microversion: 2.1 time: 0.155915 Aug 02 11:04:03.194137 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1891/3198] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:03 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:04.215016 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:04.215559 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:04.217394 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:04.219033 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:04.223918 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:04.228666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:04.228666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:04.228666 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:04.363512 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:04.371196 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ebb3d76-8c1b-44c8-93cc-43be4e48cea3 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1498 microversion: 2.1 time: 0.160167 Aug 02 11:04:04.375466 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1308/3199] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:04 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:05.204583 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:05.205208 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:05.211835 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:05.212274 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:05.213025 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:05.213447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:05.240817 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Going to try to terminate instance {{(pid=118452) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:04:05.569275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-de7e9616-e029-40e3-af63-6001807ef9a4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 204 len: 0 microversion: 2.1 time: 0.368438 Aug 02 11:04:05.569919 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1892/3200] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:04:05 2022] DELETE /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 11:04:05.578430 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:05.579093 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:05.585911 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:05.586377 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:05.587127 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:05.587605 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:05.728235 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:05.736391 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6745a98-ddc6-4c5c-965a-0f89148eb80c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1504 microversion: 2.1 time: 0.161959 Aug 02 11:04:05.736942 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1309/3201] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:05 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:06.759051 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:06.759777 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:06.766517 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:06.766957 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:06.767748 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:06.768181 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:06.898785 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:06.906447 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-89eb2f51-a14f-432b-b40f-9145d6b699cb tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1504 microversion: 2.1 time: 0.151681 Aug 02 11:04:06.907020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1893/3202] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:06 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:07.506532 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-2735b836-0625-44db-be01-2d06cc6ad062 req-6e008009-1075-4c55-ab22-f27d60916e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1d763e-c57b-4375-936c-bb472031b743", "name": "network-vif-deleted", "tag": "132cc723-3e17-4787-b484-9350f95fd52f"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:07.520699 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-2735b836-0625-44db-be01-2d06cc6ad062 req-6e008009-1075-4c55-ab22-f27d60916e70 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:07.521195 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-2735b836-0625-44db-be01-2d06cc6ad062 req-6e008009-1075-4c55-ab22-f27d60916e70 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:07.535894 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-2735b836-0625-44db-be01-2d06cc6ad062 req-6e008009-1075-4c55-ab22-f27d60916e70 service nova] Creating event network-vif-deleted:132cc723-3e17-4787-b484-9350f95fd52f for instance 4f1d763e-c57b-4375-936c-bb472031b743 on hv-cinder-84753 Aug 02 11:04:07.541086 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-2735b836-0625-44db-be01-2d06cc6ad062 req-6e008009-1075-4c55-ab22-f27d60916e70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040551 Aug 02 11:04:07.541863 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1310/3203] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:04:07.928778 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:07.929461 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:07.936654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:07.937100 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:07.937862 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:07.938290 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:07.969509 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:07.969997 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:07.970416 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.objects.instance [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lazy-loading 'fault' on Instance uuid 4f1d763e-c57b-4375-936c-bb472031b743 {{(pid=118452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:04:08.011455 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:08.019977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-39922963-ec0a-4d95-b8ea-ec797a04008f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 200 len: 1304 microversion: 2.1 time: 0.095019 Aug 02 11:04:08.019977 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1894/3204] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:07 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:09.042012 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:09.042708 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 4f1d763e-c57b-4375-936c-bb472031b743] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:09.048936 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.049379 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.050128 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.050565 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.063521 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] HTTP exception thrown: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Request method failure captured: Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 HTTP/1.1 Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept: application/json Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Connection: close Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.49 Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi6QSVqDKikqZT_sdMiMtRxrkWO4mv3bGAJF-I2A4DWpSDog8cnvnpruX7BMHoQxN9apJBy9gdZeOhyVzRymtBsgsnupHRu4AlEPFue5r4VCfXy7jfJFBO-Xpxe-t3Ev7A-8ZQq6xQhqyFAcxnbOSsAX9Djb1Fuz-G3JyQpkD3jn7rprc Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 5c7f14f32755499680d0678f349ad2aa Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Role: reader,member Aug 02 11:04:09.065621 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Roles: reader,member Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c7f14f32755499680d0678f349ad2aa", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 5c7f14f32755499680d0678f349ad2aa Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesActionsTest-2038687380-project Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Id: fcf55ad0572e4f7492ab7d73fa0cdce7 Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesActionsTest-2038687380-project Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: method: > Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: exception: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. Aug 02 11:04:09.067076 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '4f1d763e-c57b-4375-936c-bb472031b743'} Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:04:09.067854 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. Aug 02 11:04:09.068923 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Aug 02 11:04:09.069809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Returning 404 to user: Instance 4f1d763e-c57b-4375-936c-bb472031b743 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:04:09.069809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83421d3c-7b2d-49b5-9ffa-0eb004883284 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743" status: 404 len: 111 microversion: 2.1 time: 0.029964 Aug 02 11:04:09.069809 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1311/3205] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:09 2022] GET /compute/v2.1/servers/4f1d763e-c57b-4375-936c-bb472031b743 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:04:09.116125 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-723633294", "imageRef": "42af0715-4365-472b-8ec9-706547fb5ae5", "flavorRef": "452", "networks": [{"uuid": "ebb84e3e-801f-4759-85d3-444c87d1e750"}]}} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:09.169704 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.network.neutron [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] validate_networks() for [('ebb84e3e-801f-4759-85d3-444c87d1e750', None, None, None, None, None)] {{(pid=118452) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:04:09.561848 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Flavor limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:04:09.562275 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Image limits 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:04:09.562749 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Flavor pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:04:09.563210 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Image pref 0:0:0 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:04:09.563629 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.virt.hardware [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:04:09.573053 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.573502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.574323 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.574759 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.591677 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Getting quotas for project 5c7f14f32755499680d0678f349ad2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:04:09.595602 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.quota [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Getting quotas for user fcf55ad0572e4f7492ab7d73fa0cdce7 and project 5c7f14f32755499680d0678f349ad2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=118452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:04:09.606399 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Going to run 1 instances... {{(pid=118452) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:04:09.608695 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42af0715-4365-472b-8ec9-706547fb5ae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:04:09.773904 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [e5eb055b-1ab6-465f-9c9b-8a44bd49679a] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 11:04:10.784795 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [e5eb055b-1ab6-465f-9c9b-8a44bd49679a] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47882. Aug 02 11:04:10.789103 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-8eceb081-bb65-4edf-9ece-52d583b5b6b4 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676736 Aug 02 11:04:10.790034 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1895/3206] 10.222.0.49 () {60 vars in 1147 bytes} [Tue Aug 2 11:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 11:04:10.801300 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-102cc9ad-4e38-4ebd-9b04-4439d780813f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:10.801919 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-102cc9ad-4e38-4ebd-9b04-4439d780813f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:10.853433 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-102cc9ad-4e38-4ebd-9b04-4439d780813f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:10.860304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-102cc9ad-4e38-4ebd-9b04-4439d780813f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1213 microversion: 2.1 time: 0.063435 Aug 02 11:04:10.860872 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1312/3207] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:10 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:11.882261 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-fe6eb574-cb9e-4594-9a2c-8cdcb8dc7e7d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:11.882909 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-fe6eb574-cb9e-4594-9a2c-8cdcb8dc7e7d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:11.937668 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-fe6eb574-cb9e-4594-9a2c-8cdcb8dc7e7d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:11.944533 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-fe6eb574-cb9e-4594-9a2c-8cdcb8dc7e7d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1213 microversion: 2.1 time: 0.066885 Aug 02 11:04:11.945101 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1896/3208] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:11 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:12.965768 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a367c3c-68d3-424b-a899-d418fcbe32a6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:12.966457 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a367c3c-68d3-424b-a899-d418fcbe32a6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:13.035763 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1a367c3c-68d3-424b-a899-d418fcbe32a6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:13.042880 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a367c3c-68d3-424b-a899-d418fcbe32a6 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1213 microversion: 2.1 time: 0.080967 Aug 02 11:04:13.043487 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1313/3209] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:12 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:14.064063 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-b7743268-fc58-42cd-97f3-a9b0a09ae913 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:14.064682 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-b7743268-fc58-42cd-97f3-a9b0a09ae913 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:14.120510 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-b7743268-fc58-42cd-97f3-a9b0a09ae913 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:14.127293 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-b7743268-fc58-42cd-97f3-a9b0a09ae913 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1213 microversion: 2.1 time: 0.067003 Aug 02 11:04:14.127868 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1897/3210] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:14 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:15.147713 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:15.148328 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:15.154948 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:15.155429 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:15.156232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:15.156664 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:15.218343 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:15.226444 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc17bfe7-7ef8-4a3e-8b2e-074f19b35630 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1217 microversion: 2.1 time: 0.082572 Aug 02 11:04:15.227009 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1314/3211] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:15 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:16.248346 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:16.248958 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:16.256445 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:16.256881 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:16.257647 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:16.258151 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:16.325860 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:16.333722 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-265e95c8-a839-4baa-8813-0c78f497a229 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1265 microversion: 2.1 time: 0.089437 Aug 02 11:04:16.334283 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1898/3212] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:16 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:17.355201 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:17.355882 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:17.362950 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:17.363440 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:17.364222 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:17.364650 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:17.431787 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:17.439350 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4d10801e-95f9-4b9b-b4a2-141a508e7594 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1271 microversion: 2.1 time: 0.088113 Aug 02 11:04:17.439959 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1315/3213] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:17 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:18.461392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:18.462027 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:18.468956 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:18.475603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:18.475603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:18.475603 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:18.592540 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-f7b551f9-a9f8-4c6a-9cf4-9ffa88739a71 req-d5ec2fcb-c754-46a2-8d0d-ddead96628b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323bb5fc-35d2-486d-a044-6105bf075215", "tag": "641e8e37-44f9-4c62-9630-45f1da2759ea"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:18.603319 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f7b551f9-a9f8-4c6a-9cf4-9ffa88739a71 req-d5ec2fcb-c754-46a2-8d0d-ddead96628b7 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:18.604952 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f7b551f9-a9f8-4c6a-9cf4-9ffa88739a71 req-d5ec2fcb-c754-46a2-8d0d-ddead96628b7 service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:18.614960 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-f7b551f9-a9f8-4c6a-9cf4-9ffa88739a71 req-d5ec2fcb-c754-46a2-8d0d-ddead96628b7 service nova] Creating event network-changed:641e8e37-44f9-4c62-9630-45f1da2759ea for instance 323bb5fc-35d2-486d-a044-6105bf075215 on hv-cinder-84753 Aug 02 11:04:18.620176 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-f7b551f9-a9f8-4c6a-9cf4-9ffa88739a71 req-d5ec2fcb-c754-46a2-8d0d-ddead96628b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031708 Aug 02 11:04:18.620891 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1316/3214] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:04:18.708780 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:18.716762 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-45fe7d03-fd33-43b1-99e6-48a3587a717f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.259236 Aug 02 11:04:18.717343 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1899/3215] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:18 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:19.739546 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:19.740170 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:19.747023 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:19.747570 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:19.748341 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:19.748769 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:19.890161 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:19.899101 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-08d1b47c-000b-4d7b-8704-2baa73038424 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.164332 Aug 02 11:04:19.899714 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1317/3216] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:19 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:20.921388 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:20.921923 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:20.924937 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=2 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:20.930084 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.930527 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:20.931328 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.931758 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:21.070934 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:21.078781 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-3e55ebd7-33c3-41c5-9574-819fe35b7ea0 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.161295 Aug 02 11:04:21.079395 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1900/3217] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:20 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:22.099968 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:22.100499 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:22.103046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:22.108188 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:22.113589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:22.113589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:22.113589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:22.113589 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=65 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:22.260053 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:22.270244 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e839e259-5ac2-4278-90cc-d045495ca84c tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.173939 Aug 02 11:04:22.271558 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1318/3218] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:22 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:23.291789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:23.292484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:23.294763 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:23.299888 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.300330 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.301164 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.301540 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.304392 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:23.442175 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:23.450157 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-43c11aad-c5e2-4670-b323-11c4168c8e50 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.162645 Aug 02 11:04:23.456093 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1901/3219] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:23 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:23.934628 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-d800eea6-bb2d-40df-9e76-1d74ea616f2d req-74ea254c-df6d-499b-89e9-de0212f4e68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323bb5fc-35d2-486d-a044-6105bf075215", "name": "network-vif-plugged", "status": "completed", "tag": "641e8e37-44f9-4c62-9630-45f1da2759ea"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:23.944254 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:23.948329 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d800eea6-bb2d-40df-9e76-1d74ea616f2d req-74ea254c-df6d-499b-89e9-de0212f4e68c service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.948813 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d800eea6-bb2d-40df-9e76-1d74ea616f2d req-74ea254c-df6d-499b-89e9-de0212f4e68c service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.960052 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-d800eea6-bb2d-40df-9e76-1d74ea616f2d req-74ea254c-df6d-499b-89e9-de0212f4e68c service nova] Creating event network-vif-plugged:641e8e37-44f9-4c62-9630-45f1da2759ea for instance 323bb5fc-35d2-486d-a044-6105bf075215 on hv-cinder-84753 Aug 02 11:04:23.965233 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-d800eea6-bb2d-40df-9e76-1d74ea616f2d req-74ea254c-df6d-499b-89e9-de0212f4e68c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Aug 02 11:04:23.965815 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1319/3220] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:04:24.472437 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:24.473023 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:24.474815 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG dbcounter [-] [118452] Writing DB stats nova_cell0:SELECT=10 {{(pid=118452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:24.480390 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:24.480833 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:24.481584 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:24.482016 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:24.615651 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:24.623132 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-d2072a4b-0156-4173-87c3-cc35177fd0ae tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.155806 Aug 02 11:04:24.623746 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1902/3221] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:24 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:25.645620 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:25.646355 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:25.653218 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:25.653662 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:25.654425 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:25.654853 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:25.782527 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:25.790232 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc3a25c8-918a-40d8-813c-06439f880b3d tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1313 microversion: 2.1 time: 0.149989 Aug 02 11:04:25.790992 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1320/3222] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:25 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:26.810792 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:26.811377 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:26.818351 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:26.818789 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:26.819627 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:26.820087 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:26.958966 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:26.966618 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-24563f97-a750-4ca2-88eb-cf41793bf17f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1497 microversion: 2.1 time: 0.160054 Aug 02 11:04:26.967235 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1903/3223] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:26 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:27.802829 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:27.803513 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:27.811293 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:27.812058 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:27.812633 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:27.813069 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:27.839902 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:04:28.160750 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4db6c314-cbc0-4c6d-861c-96bac943a694 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "DELETE /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 204 len: 0 microversion: 2.1 time: 0.361618 Aug 02 11:04:28.161342 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1321/3224] 10.222.0.49 () {58 vars in 1239 bytes} [Tue Aug 2 11:04:27 2022] DELETE /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:04:28.170020 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:28.170663 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:28.178080 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:28.182382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:28.182382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:28.182382 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:28.330066 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.policy [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118452) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:28.341335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-0506f32b-19a0-43e7-a0b7-c4d1ecf8353f tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1503 microversion: 2.1 time: 0.172470 Aug 02 11:04:28.341335 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1904/3225] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:28 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:29.361129 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:29.362453 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:29.369107 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:29.369553 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:29.370323 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:29.370755 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:29.511284 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:29.519482 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f2f5c92f-35c4-41d7-b76b-ec417d6b2d38 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1503 microversion: 2.1 time: 0.162672 Aug 02 11:04:29.520424 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1322/3226] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:29 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:30.146844 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [req-885ed8f3-ce59-44d8-a70c-2b30b2843d6b req-d51c72b5-fa34-4a15-9e78-d6d42f884e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323bb5fc-35d2-486d-a044-6105bf075215", "name": "network-vif-deleted", "tag": "641e8e37-44f9-4c62-9630-45f1da2759ea"}]} {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:30.156842 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-885ed8f3-ce59-44d8-a70c-2b30b2843d6b req-d51c72b5-fa34-4a15-9e78-d6d42f884e4f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:30.157212 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [req-885ed8f3-ce59-44d8-a70c-2b30b2843d6b req-d51c72b5-fa34-4a15-9e78-d6d42f884e4f service nova] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:30.168391 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.compute.server_external_events [req-885ed8f3-ce59-44d8-a70c-2b30b2843d6b req-d51c72b5-fa34-4a15-9e78-d6d42f884e4f service nova] Creating event network-vif-deleted:641e8e37-44f9-4c62-9630-45f1da2759ea for instance 323bb5fc-35d2-486d-a044-6105bf075215 on hv-cinder-84753 Aug 02 11:04:30.173332 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [req-885ed8f3-ce59-44d8-a70c-2b30b2843d6b req-d51c72b5-fa34-4a15-9e78-d6d42f884e4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030834 Aug 02 11:04:30.173915 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1905/3227] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Aug 2 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:04:30.544043 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:30.544661 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:30.551515 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:30.551957 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:30.552765 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:30.553335 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:30.588736 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:30.589173 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:30.589617 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lazy-loading 'fault' on Instance uuid 323bb5fc-35d2-486d-a044-6105bf075215 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:04:30.630743 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf55ad0572e4f7492ab7d73fa0cdce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f14f32755499680d0678f349ad2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:30.638304 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f5e604a8-eb3b-4339-9442-35c101350111 tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 200 len: 1303 microversion: 2.1 time: 0.099665 Aug 02 11:04:30.638855 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1323/3228] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:30 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:31.661039 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Calling method '>' {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:31.661742 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.compute.api [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] [instance: 323bb5fc-35d2-486d-a044-6105bf075215] Fetching instance by UUID {{(pid=118452) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:31.668282 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:31.668733 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:31.669502 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:31.669939 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG oslo_concurrency.lockutils [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Lock "28ef1aed-d190-4dde-ac75-a293fcede000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:31.683703 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.wsgi [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] HTTP exception thrown: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Request method failure captured: Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: request: GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 HTTP/1.1 Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept: application/json Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Accept-Encoding: identity Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Connection: close Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Length: 0 Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Content-Type: application/json Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Host: 10.222.0.49 Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Openstack-System-Scope: None Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: User-Agent: python-urllib3/1.26.10 Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Auth-Token: gAAAAABi6QSVqDKikqZT_sdMiMtRxrkWO4mv3bGAJF-I2A4DWpSDog8cnvnpruX7BMHoQxN9apJBy9gdZeOhyVzRymtBsgsnupHRu4AlEPFue5r4VCfXy7jfJFBO-Xpxe-t3Ev7A-8ZQq6xQhqyFAcxnbOSsAX9Djb1Fuz-G3JyQpkD3jn7rprc Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Id: None Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Domain-Name: None Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Identity-Status: Confirmed Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Is-Admin-Project: True Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Id: default Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Domain-Name: Default Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Id: 5c7f14f32755499680d0678f349ad2aa Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Project-Name: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Role: reader,member Aug 02 11:04:31.685316 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Roles: reader,member Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5c7f14f32755499680d0678f349ad2aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5c7f14f32755499680d0678f349ad2aa", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Id: 5c7f14f32755499680d0678f349ad2aa Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-Tenant-Name: tempest-VolumesActionsTest-2038687380 Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User: tempest-VolumesActionsTest-2038687380-project Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Id: default Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Domain-Name: Default Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Id: fcf55ad0572e4f7492ab7d73fa0cdce7 Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: X-User-Name: tempest-VolumesActionsTest-2038687380-project Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: method: > Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: exception: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. Aug 02 11:04:31.686712 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: action_args: {'id': '323bb5fc-35d2-486d-a044-6105bf075215'} Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: {{(pid=118452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:04:31.687484 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. Aug 02 11:04:31.688588 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: ERROR nova.api.openstack.wsgi Aug 02 11:04:31.689589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: DEBUG nova.api.openstack.wsgi [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] Returning 404 to user: Instance 323bb5fc-35d2-486d-a044-6105bf075215 could not be found. {{(pid=118452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:04:31.689589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO nova.api.openstack.requestlog [None req-862076dc-e280-4911-b86b-774ef345f90a tempest-VolumesActionsTest-2038687380 tempest-VolumesActionsTest-2038687380-project] 10.222.0.49 "GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215" status: 404 len: 111 microversion: 2.1 time: 0.031109 Aug 02 11:04:31.689589 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: [pid: 118452|app: 0|req: 1906/3229] 10.222.0.49 () {58 vars in 1236 bytes} [Tue Aug 2 11:04:31 2022] GET /compute/v2.1/servers/323bb5fc-35d2-486d-a044-6105bf075215 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:04:35.996162 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:04:35.996710 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:06:22.937046 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:06:22.937741 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:06:32.090654 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:06:32.091284 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 11:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:06:39.480514 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:06:39.481075 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 11:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:07:56.005227 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:07:56.005812 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:07:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:09:42.201430 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:09:42.202040 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 11:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:09:42.947037 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:09:42.947613 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:09:52.099057 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:09:52.099671 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 11:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:09:55.919021 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:09:55.919603 dv-cinder-847536-4-iscsi devstack@n-api.service[118453]: Tue Aug 2 11:09:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:09:59.489554 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:09:59.490206 dv-cinder-847536-4-iscsi devstack@n-api.service[118452]: Tue Aug 2 11:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!